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Preface 


This book, Linear Systems and Signals, presents a comprehensive treatment of signals and linear systems at an introductory 
level. Like all my other books, it emphasizes physical appreciation of concepts through heuristic reasoning, and the use of 
metaphors, analogies, and creative explanations. Such an approach is much different from a purely deductive technique that 
uses mere mathematical manipulation of symbols. There is a temptation to treat engineering subjects as a branch of applied 
mathematics. Such an approach is a perfect match to the public image of engineering as a dry and dull discipline. It ignores 
the physical meaning behind various derivations and deprives a student of intuitive grasp and the enjoyable experience of 
logical uncovering of the subject matter. Here | have used mathematics not so much to prove axiomatic theory as to support 
and enhance physical and intuitive understanding. Wherever possible, theoretical results are interpreted heuristically and are 
enhanced by carefully chosen examples and analogies. 


This second edition, which closely follows the organization of the first edition, has been refined by incorporating suggestions 
and changes provided by various reviewers. The added topics include Bode plots, use of digital filters in an impulse-invariance 
method of designing analog systems, convergence of infinite series, bandpass systems, group and phase delay, and Fourier 
applications to communication systems. A significant and sizable addition in the area of MATLAB® (a registered trademark of 
The Math Works, Inc.) has been provided by Dr. Roger Green of North Dakota State University. Dr. Green discusses his 
contribution at the conclusion of this preface. 


ORGANIZATION 


The book may be conceived as divided into five parts: 
1. Introduction (Background and Chapter 1). 
2. Time-domain analysis of linear time-invariant (LTI) systems (Chapters 2 and 3). 
3. Frequency-domain (transform) analysis of LT| systems (Chapters 4 and 5). 


4. Signal analysis (Chapters 6, 7, 8, and 9). 


5. State-space analysis of LTI systems (Chapter 10). 


The organization of the book permits much flexibility in teaching the continuous-time and discrete-time concepts. The natural 
sequence of chapters is meant to integrate continuous-time and discrete-time analysis. It is also possible to use a sequential 
approach in which all the continuous-time analysis is covered first (Chapters 1, 2, 4, 6, 7, and 8), followed by discrete-time 
analysis (Chapters 3, 5, and 9). 


SUGGESTIONS FOR USING THIS BOOK 


The book can be readily tailored for a variety of courses spanning 30 to 45 lecture hours. Most of the material in the first eight 
chapters can be covered at a brisk pace in about 45 hours. The book can also be used for a 30-lecture-hour course by 
covering only analog material (Chapters 1, 2, 4, 6, 7, and possibly selected topics in Chapter 8). Alternately, one can also 
select Chapters 1 to 5 for courses purely devoted to systems analysis or transform techniques. To treat continuous- and 
discrete-time systems by using an integrated (or parallel) approach, the appropriate sequence of Chapters is 1, 2, 3, 4, 5, 6, 7, 
and 8. For a sequential approach, where the continuous-time analysis is followed by discrete-time analysis, the proper chapter 
sequence is 1, 2, 4, 6, 7, 8, 3, 5, and possibly 9 (depending on the time availability). 


Logically, the Fourier transform should precede the Laplace transform. | have used such an approach in the companion 
volume, Signal Processing and Linear Systems (Oxford, 1998). However, a sizable number of instructors feel that it is easier for 
students to learn Fourier after Laplace. Such an approach has an appeal because of the gradual progression of difficulty, in the 
sense that the relatively more difficult concepts of Fourier are treated after the simpler area of Laplace. This book is written to 
accommodate that viewpoint. For those who wish to see Fourier before Laplace, there is Signal Processing and Linear 
Systems. 


NOTABLE FEATURES 


The notable features of this book include the following: 


1. Intuitive and heuristic understanding of the concepts and physical meaning of mathematical results are 
emphasized throughout. Such an approach not only leads to deeper appreciation and easier comprehension of 
the concepts, but also makes learning enjoyable for students. 


2. Many students are handicapped by an inadequate background in basic material such as complex numbers, 
sinusoids, quick sketching of functions, Cramer's rule, partial fraction expansion, and matrix algebra. | have added 
a chapter that addresses these basic and pervasive topics in electrical engineering. Response by students has 
been unanimously enthusiastic. 


3. There are more than 200 worked examples in addition to exercises (usually with answers) for students to test their 
understanding. There is also a large number of selected problems of varying difficulty at the end of each chapter. 


4. For instructors who like to get students involved with computers, several examples are worked out by means of 
MATLAB, which is becoming a standard software package in electrical engineering curricula. There is also a 
MATLAB session at the end of each chapter. The problem set contains several computer problems. Working 
computer examples or problems, though not essential for the use of this book, is highly recommended. 


5. The discrete-time and continuous-time systems may be treated in sequence, or they may be integrated by using 
a parallel approach. 


6. The summary at the end of each chapter proves helpful to students in summing up essential developments in the 
chapter. 


7. There are several historical notes to enhance student's interest in the subject. This information introduces students 
to the historical background that influenced the development of electrical engineering. 
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MATLAB 


MATLAB is a sophisticated language that serves as a powerful tool to better understand a myriad of topics, including control 
theory, filter design, and, of course, linear systems and signals. MATLAB's flexible programming structure promotes rapid 
development and analysis. Outstanding visualization capabilities provide unique insight into system behavior and signal 
character. By exploring concepts with MATLAB, you will substantially increase your comfort with and understanding of course 
topics. 


As with any language, learning MATLAB is incremental and requires practice. This book provides two levels of exposure to 
MATLAB. First, short computer examples are interspersed throughout the text to reinforce concepts and perform various 
computations. These examples utilize standard MATLAB functions as well as functions from the control system, signal 
processing, and symbolic math toolboxes. MATLAB has many more toolboxes available, but these three are commonly 
available in many engineering departments. 


A second and deeper level of exposure to MATLAB is achieved by concluding each chapter with a separate MATLAB session. 
Taken together, these eleven sessions provide a self-contained introduction to the MATLAB environment that allows even 
novice users to quickly gain MATLAB proficiency and competence. These sessions provide detailed instruction on how to use 
MATLAB to solve problems in linear systems and signals. Except for the very last chapter, special care has been taken to 
avoid the use of toolbox functions in the MATLAB sessions. Rather, readers are shown the process of developing their own 
code. In this way, those readers without toolbox access are not at a disadvantage. 


All computer code is available online (http:/Avww.mathworks.com/support/books). Code for the computer examples in a given 
chapter, say Chapter xx, is named CExx.m. Program yy from MATLAB Session xx is named MSxxPyy.m. Additionally, complete 
code for each individual MATLAB session is named MSxx.m. 


Roger Green 


Chapter B: Background 


The topics discussed in this chapter are not entirely new to students taking this course. You have already studied many of these topics in earlier 
courses or are expected to know them from your previous training. Even so, this background material deserves a review because it is so pervasive in 
the area of signals and systems. Investing a little time in such a review will pay big dividends later. Furthermore, this material is useful not only for 
this course but also for several courses that follow. It will also be helpful later, as reference material in your professional career. 


B.1 COMPLEX NUMBERS 


Complex numbers are an extension of ordinary numbers and are an integral part of the modern number system. Complex numbers, particularly 
imaginary numbers, sometimes seem mysterious and unreal. This feeling of unreality derives from their unfamiliarity and novelty rather than their 
supposed nonexistence! Mathematicians blundered in calling these numbers "imaginary," for the term immediately prejudices perception. Had these 
numbers been called by some other name, they would have become demystified long ago, just as irrational numbers or negative numbers were. 
Many futile attempts have been made to ascribe some physical meaning to imaginary numbers. However, this effort is needless. In mathematics we 
assign symbols and operations any meaning we wish as long as internal consistency is maintained. The history of mathematics is full of entities that 
were unfamiliar and held in abhorrence until familiarity made them acceptable. This fact will become clear from the following historical note. 


B.1-1 A Historical Note 


Among early people the number system consisted only of natural numbers (positive integers) needed to express the number of children, cattle, and 
quivers of arrows. These people had no need for fractions. Whoever heard of two and one-half children or three and one-fourth cows! 


However, with the advent of agriculture, people needed to measure continuously varying quantities, such as the length of a field and the weight of a 
quantity of butter. The number system, therefore, was extended to include fractions. The ancient Egyptians and Babylonians knew how to handle 
fractions, but Pythagoras discovered that some numbers (like the diagonal of a unit square) could not be expressed as a whole number or a fraction. 
Pythagoras, a number mystic, who regarded numbers as the essence and principle of all things in the universe, was so appalled at his discovery that 


he swore his followers to secrecy and imposed a death penalty for divulging this secret.!"] These numbers, however, were included in the number 
system by the time of Descartes, and they are now known as irrational numbers. 


Until recently, negative numbers were not a part of the number system. The concept of negative numbers must have appeared absurd to early man. 
However, the medieval Hindus had a clear understanding of the significance of positive and negative numbers.!21 [3] They were also the first to 
recognize the existence of absolute negative quantities.[4] The works of Bhaskar (1114-1185) on arithmetic (Lilavatf) and algebra (Byaganit) not only 


use the decimal system but also give rules for dealing with negative quantities. Bhaskar recognized that positive numbers have two square roots.[5] 
Much later, in Europe, the men who developed the banking system that arose in Florence and Venice during the late Renaissance (fifteenth century) 
are credited with introducing a crude form of negative numbers. The seemingly absurd subtraction of 7 from 5 seemed reasonable when bankers 
began to allow their clients to draw seven gold ducats while their deposit stood at five. All that was necessary for this purpose was to write the 


difference, 2, on the debit side of a ledger.!®! 


Thus the number system was once again broadened (generalized) to include negative numbers. The acceptance of negative numbers made it 


possible to solve equations such as x + 5 = 0, which had no solution before. Yet for equations such as x2 +1 =0, leading to x? = —1, the solution 
could not be found in the real number system. It was therefore necessary to define a completely new kind of number with its square equal to —1. 
During the time of Descartes and Newton, imaginary (or complex) numbers came to be accepted as part of the number system, but they were still 
regarded as algebraic fiction. The Swiss mathematician Leonhard Euler introduced the notation j (for imaginary) around 1777 to represent ./—1. 
Electrical engineers use the notation j instead of i to avoid confusion with the notation i often used for electrical current. Thus 


p=-l 

and 

/-1=+j 

This notation allows us to determine the square root of any negative number. For example, 


J/-4 = V4 x /-1 = +2) 


When imaginary numbers are included in the number system, the resulting numbers are called complex numbers. 


ORIGINS OF COMPLEX NUMBERS 


Ironically (and contrary to popular belief), it was not the solution of a quadratic equation, such as x? +1 =0, but a cubic equation with real roots that 
made imaginary numbers plausible and acceptable to early mathematicians. They could dismiss ./—1 as pure nonsense when it appeared as a 


solution to x2 + 1 = 0 because this equation has no real solution. But in 1545, Gerolamo Cardano of Milan published Ars Magna (The Great Art), the 
most important algebraic work of the Renaissance. In this book he gave a method of solving a general cubic equation in which a root of a negative 


number appeared in an intermediate step. According to his method, the solution to a third-order equation!T] 
v+ax+b=0 


is vel by 


a (Ow oe 
rf-tVatatla-Vate 


Gerolume Cantans Karl Friedrich Ganes 


Gerolamo Cardano 


For example, to find a solution of x3 + 6x — 20= 0, we substitute a = 6, b = —20 in the foregoing equation to obtain 
x = 10+ V108 + / 10 — V/108 = +/20.392 — «/0.392 = 2 


We can readily verify that 2 is indeed a solution of x? + 6x — 20 = 0. But when Cardano tried to solve the equation x3 — 15x -4=0 by this 
formula, his solution was 


x=V2+/-121+(/2-V-121 


What was Cardano to make of this equation in the year 1545? In those days negative numbers were themselves suspect, and a square root of a 
negative number was doubly preposterous! Today we know that 


(2+ jP =2+ fll =24+V-121 


Therefore, Cardano's formula gives 


x=(24+j/)+(2-j) =4 


We can readily verify that x = 4 is indeed a solution of x? — 15x — 4 = 0. Cardano tried to explain halfheartedly the presence of —121 but 
ultimately dismissed the whole enterprize as being "as subtle as it is useless." A generation later, however, Raphael Bombelli (1526-1573), after 
examining Cardano's results, proposed acceptance of imaginary numbers as a necessary vehicle that would transport the mathematician from the 
real cubic equation to its real solution. In other words, although we begin and end with real numbers, we seem compelled to move into an unfamiliar 


world of imaginaries to complete our journey. To mathematicians of the day, this proposal seemed incredibly strange.” Yet they could not dismiss the 
idea of imaginary numbers so easily because this concept yielded the real solution of an equation. It took two more centuries for the full importance 
of complex numbers to become evident in the works of Euler, Gauss, and Cauchy. Still, Bombelli deserves credit for recognizing that such numbers 


have a role to play in algebra.” 


In 1799 the German mathematician Karl Friedrich Gauss, at the ripe age of 22, proved the fundamental theorem of algebra, namely that every 
algebraic equation in one unknown has a root in the form of a complex number. He showed that every equation of the nth order has exactly n 
solutions (roots), no more and no less. Gauss was also one of the first to give a coherent account of complex numbers and to interpret them as 
points in a complex plane. It is he who introduced the term "complex numbers" and paved the way for their general and systematic use. The number 
system was once again broadened or generalized to include imaginary numbers. Ordinary (or real) numbers became a special case of generalized 
(or complex) numbers. 


The utility of complex numbers can be understood readily by an analogy with two neighboring countries X and Y, as illustrated in Fig. B.1. If we want 
to travel from City a to City b (both in Country X), the shortest route is through Country Y, although the journey begins and ends in Country X. We 
may, if we desire, perform this journey by an alternate route that lies exclusively in X, but this alternate route is longer. In mathematics we have a 
similar situation with real numbers (Country X) and complex numbers (Country Y). All real-world problems must start with real numbers, and all the 
final results must also be in real numbers. But the derivation of results is considerably simplified by using complex numbers as an intermediary. It is 
also possible to solve any real-world problem by an alternate method, using real numbers exclusively, but such procedures would increase the work 
needlessly. 


Country 


Y b 


Figure B.1: Use of complex numbers can reduce the work. 


B.1-2 Algebra of Complex Numbers 


A complex number (a, 6) or a + jb can be represented graphically by a point whose Cartesian coordinates are (a, 6) in a complex plane (Fig. B.2). 
Let us denote this complex number by z so that 


z=a+jb (B.1) 


The numbers a and b (the abscissa and the ordinate) of z are the real part and the imaginary part, respectively, of z. They are also expressed as 
Rez=a 


Imz=b 
Note that in this plane all real numbers lie on the horizontal axis, and all imaginary numbers lie on the vertical axis. 


Complex numbers may also be expressed in terms of polar coordinates. If (r, 8) are the polar coordinates of a point z = a + jb (see Fig. B.2), then 
a=rcos@ 


b=rsin0 
and 
z=a+jb=rcos 0 + jrsin 0 


=r(cos 6 + j sin 9) (B.2) 


ch 


Imaginary 


Figure B.2: Representation of a number in the complex plane. 


The Euler formula states that 
e/® =cos 0+ jsiné 


To prove the Euler formula, we use a Maclaurin series to expand el? cos 8, and sin 8: 


(jer «(ey . (ey (je) _ (jays 
LOY, SEY, ION = EY = I 


iO 
aa Ss 31 4 tO! 
e2 3 64 6 Ae 
140-3 -Ig+gtig-ag-" 
e? 6+ e° (eh 
oom lm~a ta —ata 
. , 93 a 97 
sin0=0-T+5-Gt 


Hence, it follows that!T] 
e/® =cos 0+ jsin 0 (B.3) 
Using Eq. (B.3) in (B.2) yields 
z=a+jb 
= rel? (BA) 
Thus, a complex number can be expressed in Cartesian form a + jb or polar form re!® with 


a=rcosQ@, b=rsin0@ (B.5) 


and 


b 
r=vVa?+b, ¢ = wan"'(*) (B.6) 


Observe that ris the distance of the point z from the origin. For this reason, ris also called the magnitude (or absolute value) of z and is denoted by 
|z|. Similarly, 8 is called the angle of z and is denoted by 2z. Therefore 


lz] =r, iz= 
and 
z=Izle/ (B.7) 
Also 
1 1 1 1 
—-=—=-¢ ¥ -— eg lt B, 
z re?’ rf izl 5) 


CONJUGATE OF A COMPLEX NUMBER 


We define z*, the conjugate of z= a+ jb, as 
2 =a—jb=re" (B.9a) 


= |zle 4 (B.9b) 


The graphical representation of a number z and its conjugate z* is depicted in Fig. B.2. Observe that z* is a mirror image of z about the horizontal 
axis. To find the conjugate of any number, we need only replace j by —j in that number (which is the same as changing the sign of its angle). 


The sum of a complex number and its conjugate is a real number equal to twice the real part of the number: 
z+z'=(a+ jb) + (a— jb) =2a=2Rez (B.10a) 

The product of a complex number z and its conjugate is a real number Iz/2, the square of the magnitude of the number: 
zz’ = (a+ jb\a — jb) =a +b = 2)? (B.10b) 


UNDERSTANDING SOME USEFUL IDENTITIES 


In a complex plane, rel® represents a point at a distance r from the origin and at an angle @ with the horizontal axis, as shown in Fig. B.3a. For 
example, the number — 1 is at a unit distance from the origin and has an angle tr or — Tr (in fact, any odd multiple of + TT), as seen from Fig. B.3b. 
Therefore, 


let#* = -1 


Figure B.3: Understanding some useful identities in terms of rel. 


In fact, 
et — _] n odd integer (B.11) 
The number 1, on the other hand, is also at a unit distance from the origin, but has an angle 2Tr (in fact, +2ntt for any integer value of n). Therefore, 
eJ** —1  —n integer (B.12) 
The number jis at unit distance from the origin and its angle is Tt/2 (see Fig. B.3b). Therefore, 
eitl2 _ j 
Similarly, 
jr]2 : 
e —j 
Thus 
etal? = +] (B.13a) 
In fact, 


ptina/2 fe n=1,5,9,13,... (B.13b) 


+f n=3,7,11,15,... 


This discussion shows the usefulness of the graphic picture of rel This picture is also helpful in several other applications. For example, to determine 


the limit of e(+)t as t — oo, we note that 


gation = e@ giv 


Now the magnitude of elt ig unity regardless of the value of w or t because elt = rel® with r = 1. Therefore, e“! determines the behavior of e(*/™)t 
as t > o and 


0 a<0 
a>0O 


a (B.14) 


lim e“*/°" = lim e“e/" = { 
tre ow 


In future discussions you will find it very useful to remember re!® as a number at a distance r from the origin and at an angle 8 with the horizontal 
axis of the complex plane. 
A WARNING ABOUT USING ELECTRONIC CALCULATORS IN COMPUTING ANGLES 


From the Cartesian form a + jb we can readily compute the polar form rel® [see Eq. (B.6)]. Electronic calculators provide ready conversion of 
rectangular into polar and vice versa. However, if a calculator computes an angle of a complex number by using an inverse trigonometric function 6 = 


tan“| (b/a), proper attention must be paid to the quadrant in which the number is located. For instance, 8 corresponding to the number —2 — j3 is 
tan~' (—3/—2). This result is not the same as tan™! (3/2). The former is —123.7°, whereas the latter is 56.3°. An electronic calculator cannot make 


this distinction and can give a correct answer only for angles in the first and fourth quadrants. It will read tan71(—3/-2) as tan™' (3/2), which is 
clearly wrong. When you are computing inverse trigonometric functions, if the angle appears in the second or third quadrant, the answer of the 
calculator is off by 180°. The correct answer is obtained by adding or subtracting 180° to the value found with the calculator (either adding or 
subtracting yields the correct answer). For this reason it is advisable to draw the point in the complex plane and determine the quadrant in which the 
point lies. This issue will be clarified by the following examples. 


EXAMPLE B.1 
Express the following numbers in polar form: 


a. 2+)3 
b. -2+ 3 
6-2-7 
dit = 78 


a l= V2+3=V713 fz = tan! (3) = 56.3° 


In this case the number is in the first quadrant, and a calculator will give the correct value of 56.3°. Therefore (see Fig. B.4a), we can 


write 


2+ j3 = 713 e/* 
= V(-2" +2 =V5 fz =tan™ (4) = 153.4 


Tt tT 


(a) (b) 


{c) (d) 


Figure B.4: From Cartesian to polar form. 


In this case the angle is in the second quadrant (see Fig. B.4b), and therefore the answer given by the calculator, tan“! (1/—2) = 
—26.6°, is off by 180°. The correct answer is (—26.6 + 180)° = 153.4° or —206.6°. Both values are correct because they represent the 
same angle. 


It is a common practice to choose an angle whose numerical value is less than 180°. Such a value is called the principal value of the 
angle, which in this case is 153.4°. Therefore, 


—2+ jl = V5e* 
> l= VAP + C3P = V8 fz = tan (=3) = - 123.7 


In this case the angle appears in the third quadrant (see Fig. B.4c), and therefore the answer obtained by the calculator (tan~' (—3/-2) 
= 56.3°) is off by 180°. The correct answer is (56.3° 180)° = 236.3° or —123.7°. We choose the principal value — 123.7° so that (see 
Fig. B.4c). 


-2 — j3 = V13e14" 
a l= VP 4 C32 =J10 z= tan (=) = -71.6° 


In this case the angle appears in the fourth quadrant (see Fig. B.4d), and therefore the answer given by the calculator, tan™! (-—3/1) = 
—71.6°, is correct (see Fig. B.4d): 


1— j3 = S107!" 


COMPUTER EXAMPLE CB.1 
Using the MATLAB function cart2pol1, convert the following numbers from Cartesian form to polar form: 


a. Z=2+ 73 
b. z=-2+/1 
>> [z_rad, z_mag] = cart2pol(2, 3); 
>> z_deg = z_rad* pee i); 
>> disp([' Ao) z_mag = ',num2str(z_ma he, z_rad = ',num2str(z_rad), 
>> z_deg = 'num2str(Z_ deg) 


(a) z mag 3.6056; z "rad = 0. 98279; Z deg = 56.3099 


b. Therefore, z = 2 + j3 = 3.6056e/9-98279 + 3.6056 @/56-3099° 


>> [z_rad, z_mag] = cart2pol(-2, 1); 


>> z_deg = z_rad* pee i); 

>> disp [' "(by z_mag = ,num2str(z_ma r '; z_rad = ',num2str(z_rad), 
>> ; z_deg = ' numastr (Z_ deg) . 

(b) z mag = 2.2361; z "rad = 2. 6779; deg = 153.4349 


Therefore, z = —2 + j1 = 2.2361¢/2.6779 = 2.2361 ¢/153.4349" 


EXAMPLE B.2 


Represent the following numbers in the complex plane and express them in Cartesian form: 
a. 22/73 
b. 4e7/3m/4 
c. 2e/T/2 
d. 3e/3T 
e. 26/47 
f. 2e/47 


a. 2e/T/3 = 2(cos 11/3 + j sin 11/3) = 1 +/ V3 (See Fig. B.5b) 


(a) (b) 


(e) (f) 
Figure B.5: From polar to Cartesian form. 


b. 4e 7/4 = a(cos 31/4 — j sin 17/4) = —2./2 — j2 /2 (See Fig. B.5b) 
c. 2e/T/2 = 2(cos 1/2 + j sin 11/2) = 2(0 + j 1) = j2 (See Fig. B.5c) 

d. 3e/3T = 2(cos 3m — j sin 311) = 3(—1 + j0) = —3 (See Fig. B.5d) 

e. 2e/4T = 2(cos 411 + j sin 411) = 2(1 — j0) = 2 (See Fig. B.5e) 


f. 2e /4™ = 2(cos 4m — j sin 411) = 2(1 — j0) = 2 (See Fig. B.5f) 


COMPUTER EXAMPLE CB.2 


Using the MATLAB function pol2cart, convert the number z = 4eSS8T/4) from polar form to Cartesian form. 


>> [z_real, z_imag] = pol2cart(-3*pi/4,4); |. . 
>> disp (['z_real = ',num2str(z_real),'; Z_imag = ',num2str(z_imag)]); 
z real = -2.8284; z imag = -2.8284 


Therefore, z = 4e/(8T/4) = — 2.8284 — 2.8284. 


ARITHMETICAL OPERATIONS, POWERS, AND ROOTS OF COMPLEX NUMBERS 
To perform addition and subtraction, complex numbers should be expressed in Cartesian form. Thus, if 


zy = 34+ j4= 5/3" 


and ; 
2 =2+ j3 = V13¢!** 


then 


yt+w2= (34+ j4) + (24+ 73) =54+j7 


If z1 and Zz are given in polar form, we would need to convert them into Cartesian form for the purpose of adding (or subtracting). Multiplication and 
division, however, can be carried out in either Cartesian or polar form, although the latter proves to be much more convenient. This is because if z4 
and z2 are expressed in polar form as 


zi =rie™ and = re!® 
then 

ZizZo = (rie! )(rye!™) = ryryei Or (B.15a) 
and 

Zi ne” _ 1 ja-o) (B.15b) 

za mee rs - 
Moreover, 

" — (rel?)" = tein? (B.15c) 
and 

ol" = (rel?) ™ = piineidin (B.15d) 


This shows that the operations of multiplication, division, powers, and roots can be carried out with remarkable ease when the numbers are in polar 
form. 


Strictly speaking, there are n values for ziin (the nth root of z). To find all the n roots, we reexamine Eq. (B.15d). 


= fret pte frel@eeeby® co pingi@ettve =k 20,1,2,....n-1  (B.15e) 


The value of z‘/” given in Eq. (B.15d) is the principal value of z‘/ 


the case k = 0 in Eq. (B.15e). 


, obtained by taking the nth root of the principal value of z, which corresponds to 


EXAMPLE B.3 


Determine z4Z2 and z4/zZ2 for the numbers 


a= 3+ j4 = Sei” 
z= 24+ j3 =V13e!%* 


We shall solve this problem in both polar and Cartesian forms. 


MULTIPLICATION: CARTESIAN FORM 
Z1Z2 = (3 + §4)(2 + #3) = (6 — 12) + §(8 +9) = -6+ j17 


MULITPLICATION: POLAR FORM 

ida = (Se!")(S 130) = SV 13e1* 
DIVISION: CARTESIAN FORM 

Z1 3+ 74 

m2 2+-93 


To eliminate the complex number in the denominator, we multiply both the numerator and the denominator of the right-hand side by 2 — 3, the 
denominator's conjugate. This yields 


ua 3+ j4(2—- 73)  18-jl_ 18-jl_ 18 a 


z (2+ j3)(2—j3) 2+3? 13 13°13 
DIVISION: POLAR FORM 

oo iad - > pits3.1°-56.3" = a ie 

Zz. -o/13¢i563" 4/13 J13 


It is clear from this example that multiplication and division are easier to accomplish in polar form than in Cartesian form. 


EXAMPLE B.4 


For z1 = 2e/™4 and zp = 8e/™3, find the following: 


a. 2z4 = Z9 


b. 1/z4 
c; z4/z75 
d. 022 


a. Since subtraction cannot be performed directly in polar form, we convert z1 and Zo to Cartesian form: 


= 2¢/*/4 = 2( cos 7 z t+ Jsin *\= /2+ jv2 


22 = Sel"? a 8( cos =s + j sin =) =4+4 j4v3 


Therefore, 


22) — zp = 2(V2 + jv2) — (4+ j4v3) 
= (2/2 —4) + j(2V2 — 4/3) 


= -—1.17 — j4.1 
Be ee bgt 
b.z1 els 2 
s jx/4 jz, 
a1 2e!*" - 2e/*! - | ienjs—20/3) = J -iesni2) 
c.  (Bei*/3)2— Gel® 32 32 


d. There are three cube roots of 8e/(™3) = geii(T/S+2k) , = 9, 4, 2. 
fs, = 2? = [geil any) a 81/3 (eile smn)? Qei™!9 Aei™*/9 apit3n/9 


The principal value (value corresponding to k = 0) is 2/9. 


COMPUTER EXAMPLE CB.3 
Determine z4Z2 and z4/Zo if z1 =3 + j4 and zp = 2 + j3 


>> Z_1 = 3+j*4; 22 = 2+j*3; 

ee Zz iz 2 = Zz itz 2) 

>> z_idivz_2 =z V/z_ 2; 

>> gap: z_1*z_2 = yhumastr (Z. 1 z_2),'; z_1/z_2 = ',num2str(z_idivz_2)]); 
z1*z 2 = -6+17i; z 1 2 = 1.3846-0.0769231 


Therefore, z1Z> = (3 + j4)(2 + j3) = -6 + j17 and z4/z> = (3 + j4)(2 + 3) = 1.3486 — j0.076923. 


EXAMPLE B.5 
Consider X(w), a complex function of a real variable w: 


2+ jw 


a. Express X(w) in Cartesian form, and find its real and imaginary parts. 
b. Express X(w) in polar form, and find its magnitude |X(w)| and angle 2X(w). 


a. To obtain the real and imaginary parts of X (w), we must eliminate imaginary terms in the denominator of X (w). This is readily done by 
multiplying both the numerator and the denominator of X(w) by 3 — j4w, the conjugate of the denominator 3 + j4w so that 


X(w) = 2 Jon = jdm) _ (6+4a*)- jSw 6+40° Sw 
~ G+ i40\G—}4o) 9416 —*O+ 16a?" OFar 
This is the Cartesian form of X(w). Clearly the real and imaginary parts X(w) and X;(w) are given by 
6 + 4a” —5Sw 
X;(@) = —— and X;(@) = ——_—— 
. 9 + 16a? ‘ 9 + 16a? 


Xo 2+jo _ V4 + a ef ta (w/2) 
= 3+ j4o j4o 9 + 16a2 ef ar! Ge/3) 


jftan™! (w/2)—tan™' (4w/3)) 


This is the polar representation of X(w). Observe that 


Xx - | 4+? xX ax _ {@ = 4m 
| (@)| = \ 94 1602 04 loa? L£X(q@) = tan > — tan > 


LOGARITHMS OF COMPLEX NUMBERS 


We have 
log(z;z2) = log z; + log z» (B.16a) 
log(z:/z2) = log z1 — log z2 (B.16b) 
q@t) — @® x g® (B.16¢c) 
o=ae™ (B.16d) 
a = en (B.16¢) 

if 

z=re =r) = f=0,1,2,3.,... 

then 
Inz = In (re!) =Inr + j(0+27k) k=0,1,2,3,... (B.16f) 


The value of In z for k = 0 is called the principal value of In z and is denoted by Ln z. 


In] = In(le*"*) =+j2rk k=0,1,2,3,... (B.17a) 

In(—1) = Infle*/**) = +7 (2k + Ix k = 0,1,2,3,... (B.17b) 
aa (144k 

Inj = in(e*0#4072) = ZEN k= 0,1,2,3,... (B.17¢) 

PHIM =e — ¢=0,1,2,3,... (B.17d) 


In all these expressions, the case of k = 0 is the principal value of that expression. 
[]Calinger, R., ed. Classics of Mathematics. Moore Publishing, Oak Park, IL, 1982. 
[2]Hogben, Lancelot. Mathematics in the Making. Doubleday, New York, 1960. 
[3]Cajori, Florian. A History of Mathematics, 4th ed. Chelsea, New York, 1985. 
[4]Encyclopaedia Britannica. Micropaedia IV, 15th ed., vol. 11, p. 1043. Chicago, 1982. 
[5]Singh, Jagjit. Great Ideas of Modern Mathematics. Dover, New York, 1959. 
[6]Dunham, William. Journey Through Genius. Wiley, New York, 1990. 

[t]This equation is known as the depressed cubic equation. A general cubic equation 


y+py+qy+r=0 


can always be reduced to a depressed cubic form by substituting y = x — (p/3). Therefore any general cubic equation can be solved if we know the 
solution to the depressed cubic. The depressed cubic was independently solved, first by Scipione del Ferro (1465-1526) and then by Niccolo Fontana 
(1499-1557). The latter is better known in the history of mathematics as Tartaglia ("Stammerer"). Cardano learned the secret of the depressed cubic 
solution from Tartaglia. He then showed that by using the substitution y = x — (p/3), a general cubic is reduced to a depressed cubic. 


[tlt can be shown that when we impose the following three desirable properties on an exponential e7 where z = x + jy, we come to conclusion that 
el = cos y +jsin y (Euler equation). These properties are 


1. e7 is a single-valued and analytic function of z. 
2. de7/dz = e” 


3. e7 reduces to e” if y = 0. 


B.2 SINUSOIDS 


Consider the sinusoid 


x(t) = Ccos (27 fot + 0) (B.18) 


We know that 
cos y = cos(g + 2nz) n=O, +1, +2, +3,... 


Therefore, cos repeats itself for every change of 21 in the angle ¢. For the sinusoid in Eq. (B.18), the angle 21rfpt + 8 changes by 2Tt when t 
changes by 1/fp. Clearly, this sinusoid repeats every 1/fo seconds. As a result, there are fp repetitions per second. This is the frequency of the 
sinusoid, and the repetition interval To given by 


mS 
fo 


is the period. For the sinusoid in Eq. (B.18), C is the amplitude, fp is the frequency (in hertz), and 8 is the phase. Let us consider two special cases 
of this sinusoid when 6 = 0 and 6 = —T1/2 as follows: 


T (B.19) 


a. x(t) = C cos 2T1fot (6 = 0) 
b. x(t) = C cos (2TIfpt — 1/2) = C sin 2Trfpt (8 = —Tr/2) 


The angle or phase can be expressed in units of degrees or radians. Although the radian is the proper unit, in this book we shall often use the 
degree unit because students generally have a better feel for the relative magnitudes of angles expressed in degrees rather than in radians. For 
example, we relate better to the angle 24° than to 0.419 radian. Remember, however, when in doubt, use the radian unit and, above all, be 
consistent. In other words, in a given problem or an expression do not mix the two units. 


It is convenient to use the variable Wo (radian frequency) to express 2Tt/fo: 
Wy = 21 fo (B.20) 


With this notation, the sinusoid in Eq. (B.18) can be expressed as 
x(t) = C cos (wot + 0) 


in which the period To is given by [see Eqs. (B.19) and (B.20)] 


1 2x 
bh = —— = — B,21¢ 
© @/2t Wo 8) 
and 
2x 
= — B.21b 
Mo Th ( ) 


In future discussions, we shall often refer to Wo as the frequency of the signal cos (Wot + 8), but it should be clearly understood that the frequency 
of this sinusoid is fo Hz (fo = Wo/2TT), and Wo is actually the radian frequency. 


The signals C cos wot and C sin woft are illustrated in Fig. B.6a and B.6b, respectively. A general sinusoid C cos (Wot + 8) can be readily sketched 
by shifting the signal C cos Wot in Fig. B.6a by the appropriate amount. Consider, for example, 


x(t) = C cos (@ot — 60°) 


Caney 


Figure B.6: Sketching a sinusoid. 


This signal can be obtained by shifting (delaying) the signal C cos wot (Fig. B.6a) to the right by a phase (angle) of 60°. We know that a sinusoid 


undergoes a 360° change of phase (or angle) in one cycle. A quarter-cycle segment corresponds to a 90° change of angle. We therefore shift (delay) 
the signal in Fig. B.6a by two-thirds of a quarter-cycle segment to obtain C cos (Wot — 60°), as shown in Fig. B.6c. 


Observe that if we delay C cos Wof in Fig. B.6a by a quarter-cycle (angle of 90° or Tr/2 radians), we obtain the signal C sin wot, depicted in Fig. 
B.6b. This verifies the well-known trigonometric identity 


C cos (@ot — 2/2) = C sin wol (B.22a) 
Alternatively, if we advance C sin wot by a quarter-cycle, we obtain C cos Wot. Therefore, 
C sin (@of + 2/2) = C cos wol (B.22b) 


This observation means sin Wof lags cos Wot by 90°(Tr/2 radians), or cos Wof leads sin Wot by 90°. 


B.2-1 Addition of Sinusoids 


Two sinusoids having the same frequency but different phases add to form a single sinusoid of the same frequency. This fact is readily seen from the 
well-known trigonometric identity 


C cos (at +0) = Coos 0 cos wt — C sin 6 sin mot 


= ACOs ay + bsin wot (B.23a) 
in which 
a=Ccos 0 and b= —C sin 0 
Therefore, 
C= Va?+b? (B.23b) 
—b 
6 = tan7! (=) (B.23c) 
a 


Equations (B.23b) and (B.23c) show that C and 6 are the magnitude and angle, respectively, of a complex number a — jb. In other words, a — jb = 
Ce®. Hence, to find C and 8, we convert a — jb to polar form and the magnitude and the angle of the resulting polar number are C and 6, 


respectively. 
To summarize, 
@ COS Wolf +b sin @of = C cos (Wot + 0) (B.23d) 
in which C and @ are given by Eqs. (B.23b) and (B.23c), respectively. These happen to be the magnitude and angle, respectively, of a — jb. 


The process of adding two sinusoids with the same frequency can be clarified by using phasors to represent sinusoids. We represent the sinusoid C 
COS (Wof + 8) by a phasor of length C at an angle 6 with the horizontal axis. Clearly, the sinusoid a cos Wot is represented by a horizontal phasor of 


length a (6 = 0), while b sin Wot = b cos (Wot — Tt/2) is represented by a vertical phasor of length b at an angle — 11/2 with the horizontal (Fig. B.7). 


Adding these two phasors results in a phasor of length C at an angle 0, as depicted in Fig. B.7. From this figure, we verify the values of C and 6 
found in Eqs. (B.23b) and (B.23c), respectively. 


Figure B.7: Phasor addition of sinusoids. 


Proper care should be exercised in computing 8, as explained on page 8 ("A Warning About Using Electronic Calculators in Computing Angles"). 


EXAMPLE B.6 
In the following cases, express x(t) as a single sinusoid: 


a. x(t) = cos Wot — V3 sin wot 


b. x(t) = —3 cos Wot + 4 sin Wot 


a. In this case, a = 1, b = —./3, and from Eqs. (B.23) 
4 2 
C =1/12 + (V3) =2 
1/{V3 ° 
0 =tan' (32) = 60 
Therefore, 7 
x(t) = 2.cos (@pt + 60°) 
We can verify this result by drawing phasors corresponding to the two sinusoids. The sinusoid cos Wot is represented by a phasor of 
unit length at a zero angle with the horizontal. The phasor sin Wot is represented by a unit phasor at an angle of —90° with the 


horizontal, Therefore, — /3 sin Wof is represented by a phasor of length \/2 at 90° with the horizontal, as depicted in Fig. B.8a. The two 
phasors added yield a phasor of length 2 at 60° with the horizontal (also shown in Fig. B.8a). 


1 Re~ 


(a) (b) 
Figure B.8: Phasor addition of sinusoids. 


Alternately, we note that a — jb = 1 + j./3 = 2e/™/3. Hence, C = 2 and @ = 71/3. 


Observe that a phase shift of +T™T amounts to multiplication by —1. Therefore, x(t) can also be expressed alternatively as 


x(t) = —2 cos (art + 60° + 180°) 
= —2 0s (@pt — 120°) 


= —2 cos (wot + 240°) 
In practice, the principal value, that, is, —120°, is preferred. 
b. In this case, a = —3, b = 4, and from Eqs. (B.23) we have 
C= V(-32 +4 =5 
6 =tan' (=) = —126.9° 


Observe that 
tan“! (=$) # tan“! (4) = 53.1° 


Therefore, 


x(t) = 5cos (@pt — 126.9°) 


This result is readily verified in the phasor diagram in Fig. B.8b. Alternately, a — jb = —3 —j4 = 5e/126-9". Hence, C = 5 and @ = 
—126.9°. 


COMPUTER EXAMPLE CB.4 
Express f(t) = —3 cos (Wof) + 4 sin (Wot) as a single sinusoid. 


Notice that a cos (Wf) + b sin (Wot) = C cos [Wot + tan“! (—b/a)]. Hence, the amplitude C and the angle @ of the resulting sinusoid are the 
magnitude and angle of a complex number a — jb. 


>> a= -3; b= 4; 

>> [theta,C] cart2pol(a, -b); 

>> theta_deg (180/pi)*theta; 

>> disp(['C = ',num2str(C),'; theta = ',num2str(theta),... 
>> '; theta_deg = ',nu,2str(theta_deg)]); 

C = 5; theta = -2.2143; theta deg = -126.8699 


Therefore, f(t) = —3 cos (Wot) + 4 sin (Wot) = 5 cos (Wot — 2.2143) = 5 cos (Wot — 126.8699°). 
We can also perform the reverse operation, expressing 

x(t) = C cos (wot + 0) 

in terms of cos Wot and sin Wot by means of the trigonometric identity 

C cos (@ot + 8) = C cos @ cos wot — C sin @ sin wot 


For example, 


10 cos (wot — 60°) = Scos wot + 53 sin wot 


B.2-2 Sinusoids in Terms of Exponentials: Euler's Formula 


Sinusoids can be expressed in terms of exponentials by using Euler's formula [see Eq. (B.3)] 


1. 

cos Y = een +e ?*) (B.24a) 

Vos ce 

sin g = —(e’? —e-’*) (B.24b) 

2j 
Inversion of these equations yields 
e” = cos p+ j sin y (B.25a) 
ee” =cos p—jsing (B.25b) 


B.3 SKETCHING SIGNALS 


In this section we discuss the sketching of a few useful signals, starting with exponentials. 


B.3-1 Monotonic Exponentials 


The signal eat decays monotonically, and the signal eat grows monotonically with t (assuming a > 0) as depicted in Fig. B.9. For the sake of 
simplicity, we shall consider an exponential eat starting at t = 0, as shown in Fig. B.10a. 


(a) {b) 


Figure B.9: Monotonic exponentials. 


fa) (b) 


Figure B.10: (a) Sketching eat (b) Sketching en. 


The signal e~@ has a unit value at t = 0. At t = 1/a, the value drops to 1/e (about 37% of its initial value), as illustrated in Fig. B.10a. This time 
interval over which the exponential reduces by a factor e (i.e., drops to about 37% of its value) is known as the time constant of the exponential. 


Therefore, the time constant of e~@! is 1/a. Observe that the exponential is reduced to 37% of its initial value over any time interval of duration 1/a. 
This can be shown by considering any set of instants t; and tp separated by one time constant so that 


Now the ratio of e~@ to e~@7 is given by 


i ae | 
axe gE ce £5,0.37 
e~an e 


We can use this fact to sketch an exponential quickly. For example, consider 


The time constant in this case is 0.5. The value of x(t) at f= 0 is 1. At f= 0.5 (one time constant) it is 1/e (about 0.37). The value of x(t) continues 
to drop further by the factor 1/e (37%) over the next half-second interval (one time constant). Thus x(t) at f= 1 is (1/e)?. Continuing in this manner, 
we see that x(t) = (1/e)3 at t= 1.5, and so on. A knowledge of the values of x(t) at t = 0, 0.5, 1, and 1.5 allows us to sketch the desired signal as 
shown in Fig. B.10b.!11 


For a monotonically growing exponential e@, the waveform increases by a factor e over each interval of 1/a seconds. 


B.3-2 The Exponentially Varying Sinusoid 
We now discuss sketching an exponentially varying sinusoid 

x(t) = Ae cos (@ot +0) (B.26) 
Let us consider a specific example: 

x(t) = 4e~™ cos (61 — 60°) (B.27) 
We shall sketch 4e~2! and cos (6t — 60°) separately and then multiply them: 


i. Sketching 4e~*t. This monotonically decaying exponential has a time constant of 0.5 second and an initial value of 4 at t = 0. 
Therefore, its values at t = 0.5, 1, 1.5, and 2 are 4/e, Ale”, 4/e3, and Ale, or about 1.47, 0.54, 0.2, and 0.07, respectively. Using these 
values as a guide, we sketch 4e2t, as illustrated in Fig. B.11a. 


ii. Sketching cos (6t — 60°). The procedure for sketching cos (6t — 60°) is discussed in Section B.2 (Fig. B.6c). Here the period of the 
sinusoid is Tg = 211/6 = 1, and there is a phase delay of 60°, or two-thirds of a quarter-cycle, which is equivalent to a delay of about 
(60/360)(1) = 1/6 second (see Fig. B.11b). 


fa) 


cos (6f — G0") 
I cos 6f 


z > 
de 4e~2* cos (6¢ — 60°) 


Figure B.11: Sketching an exponentially varying sinusoid. 


ii. Sketching 4e~2! cos (6t — 60°). We now multiply the waveforms in steps i and ii. This multiplication amounts to forcing the sinusoid 4 
cos (6t — 60°) to decrease exponentially with a time constant of 0.5. The initial amplitude (at t = 0) is 4, decreasing to 4/e (= 1.47) att = 
0.5, to 1.47/e (= 0.54) at t= 1, and so on. This is depicted in Fig. B.11c. Note that when cos (6t — 60°) has a value of unity (peak 
amplitude), 


4e~™ cos (6t — 60°) = 4e~-” (B.28) 


Therefore, 4e~2! cos (6t — 60°) touches 4e~2t at the instants at which the sinusoid cos (6t — 60°) is at its positive peaks. Clearly 4e~t is an 
envelope for positive amplitudes of4e~2! cos (6t — 60°). Similar argument shows that 4e~2! cos (6t — 60°) touches —4e~! at its negative peaks. 
Therefore, —4e~2! is an envelope for negative amplitudes of 4e~2! cos (6t — 60°). Thus, to sketch 4e~2! cos (6t — 60°), we first draw the envelopes 


4e-2! and —4e2! (the mirror image of 4e~2! about the horizontal axis), and then sketch the sinusoid cos (6t — 60°), with these envelopes acting as 
constraints on the sinusoid's amplitude (see Fig. B.11c). 


In general, Ke~#! cos (Wot + 8) can be sketched in this manner, with Ke~@ and —Ke7@ constraining the amplitude of cos (Wot + 9). 


[t]lf we wish to refine the sketch further, we could consider intervals of half the time constant over which the signal decays by a factor 1/,/e. Thus, 
at t = 0.25, x(t) = 1//e, and at t = 0.75, x(t) = 1/eV/e, and so on. 


B.4 CRAMER'S RULE 


Cramer's rule offers a very convenient way to solve simultaneous linear equations. Consider a set of n linear simultaneous equations in n unknowns 
X45 XD Xp: 


AX, + y2X2 Fs FA Xn = V1 
Ay X, + AX. +++ + AyXn = V2 


(B.29) 
QAniX1 + An2X2 + +++ + AnnXn = Vn 
These equations can be expressed in matrix form as 
4, G2 ++: Ay Xy yi 
42, 422 °°" Ax» x2 y2 
=]. (B.30) 
Oni Gn2 2a? Gan Xn Yn 


We denote the matrix on the left-hand side formed by the elements aj as A. The determinant of A is denoted by |A]. If the determinant |A| is not 
zero, the set of equations (B.29) has a unique solution given by Cramer's formula 


ID, | 
|Al 
where |D,| is obtained by replacing the kth column of |A| by the column on the right-hand side of Eq. (B.30) (with elements y1, y2,..., Yn). 


x= mm 152; iniegtt (B.31) 


We shall demonstrate the use of this rule with an example. 


EXAMPLE B.7 


Use Cramer's rule to solve the following simultaneous linear equations in three unknowns: 


2x, +%2 +13 =3 
X, + 3x2 -—¥3 =7 


M ++ =1 


In matrix form these equations can be expressed as 


2; i l xX 3 
1 3 -—1| |x} =|7 
a’ a | X3 1 
Here, 
pa) Cs 
|A‘=|1 3 -1|=4 
ae ee | 
Since |A| = 4 + 0, a unique solution exists for x1, x2, and x3. This solution is provided by Cramer's rule [Eq. (B.31)] as follows: 
a= k F 
| a 8 
xy =—|]7 3 -l|=-=2 
~ lll; a a] 4 
eT ae 
“Fa tg) * 
a ae 
Lie : —8 
Dre 13 7j=-—=-2 
Sls. x t| 3 


B.5 PARTIAL FRACTION EXPANSION 


In the analysis of linear time-invariant systems, we encounter functions that are ratios of two polynomials in a certain variable, say x. Such functions 
are known as rational functions. A rational function F(x) can be expressed as 


byx™ + br" 609 oF bx + by 


F(x) = (B.32) 
X” + nix"! +++ + aiX + do 
P(x) 
= (B.33 
Q(x) 


The function F(x) is improper if m 2 n and proper if m <n. An improper function can always be separated into the sum of a polynomial in x and a 
proper function. Consider, for example, the function 


2x? + 9x? + llx +2 
x) = —————— B.34¢ 
F(x) 44x43 es 


Because this is an improper function, we divide the numerator by the denominator until the remainder has a lower degree than the denominator. 


+ 
x? +4x +3 )2x3 49x? + 11x +2 
2x3 + 8x? + 6x 
x?+5x+2 
x7 +4x +3 
x-1 


Therefore, F(x) can be expressed as 


2x? + 9x? + Ix +2 x-1 
és cennigtmneiiane as. De 459 B.34b 
=) x? 44x 43 a) +2yard3 ( ) 
polynomial in x 
peoper function 


A proper function can be further expanded into partial fractions. The remaining discussion in this section is concerned with various ways of doing this. 


B.5-1 Method of Clearing Fractions 


A rational function can be written as a sum of appropriate partial fractions with unknown coefficients, which are determined by clearing fractions and 
equating the coefficients of similar powers on the two sides. This procedure is demonstrated by the following example. 


EXAMPLE B.8 


Expand the following rational function F(x) into partial fractions: 


x°+3x?7+4x +6 


Fo) = 
) (x +1)(x +2)(x + 3)? 


This function can be expressed as a sum of partial fractions with denominators (x + 1), (x + 2), (x + 3), and (x + 3/2, as follows: 
43x? +4x +6 ky ky ky ky 


F(x) = ——————— = —— + —- + — - + — 
, (x +1)(x +2)(x4+3)? x+1 x+2 244+3 (x 4+3)? 


To determine the unknowns k1, kz, k3, and k4 we clear fractions by multiplying both sides by (x + 1)(x + 2)(x + 3)? to obtain 
x? 4 3x? + 4x 46 = k(x? + 8x? 4+ 21x + 18) + (x? + 7x? + 15x +9) 


+-ka(x* + 6x? + 11x +6) + ky(x? + 3x +2) 
= x7 (ky + ky + ky) + x7(8Ky + Thy + Oks + hy) 
+x(21Ky + Sk + LD ky + 3ka) + (18K; + 9k> + Oky + 2ky) 


Equating coefficients of similar powers on both sides yields 


ki thk+k =1 

8k, + 7k. + 6ks +k, =3 
21k, + 15k2 + 11k3 + 3ky =4 
18k; + 9k. + 6k + 2ks = 6 


Solution of these four simultaneous equations yields 


ky = 1, k, = —2, k, = 2, ky = —3 
Therefore, 


2 2 3 
F(x) = on 


x+1 T42°543 OTS) 


Although this method is straightforward and applicable to all situations, it is not necessarily the most efficient. We now discuss other methods that 
can reduce numerical work considerably. 


B.5-2 The Heaviside "Cover-Up" Method 


Distinct Factors Of Q(x) 


We shall first consider the partial fraction expansion of F(x) = P(x)/Q(x), in which all the factors of Q(x) are distinct (not repeated). Consider the 
proper function 


Do X™ + Dy 1X! $ +++ + Dx + bo 
F(x) aq ————— mean 
XP te Ayg_pX8-! f+ aX + Ay 
P(x) 


2 (B.35a) 
(X — Ai )(X — Az) +++ (4 — An) 


We can show that F(x) in Eq. (B.35a) can be expressed as the sum of partial fractions 


ky ky Kn 


F(x) = ——— sobs (B.35b 
, x¥-A1 X-A X—An 
To determine the coefficient k;, we multiply both sides of Eq. (B.35b) by x — A4 and then let x = A. This yields 
; ky(x Ay) . k3(x — Ad) n(x — Ay) 
X—A))F(x)|,2;, = k& pe EN ee ooh 
EMC ht) Gade (x — Ae) bends 


On the right-hand side, all the terms except k; vanish. Therefore, 

ky = (x —AL) F(x) lena, (B.36) 
Similarly, we can show that 

kp = (x —A,)F(x)haa, Pie D2 nus, n (B.37) 


This procedure also goes under the name method of residues. 


EXAMPLE B.9 

Expand the following rational function F(x) into partial fractions: 
2x? + 9x —11 k, ky k3 

F(x) = 


(x + 1)(x —2)(x +3) ~ X+1 er 


To determine k,, we let x = —1 in (x + 1) F(x). Note that (x + 1)F(x) is obtained from F(x) by omitting the term (x + 1) from its denominator. 
Therefore, to compute k; corresponding to the factor (x + 1), we cover up the term (x + 1) in the denominator of F(x) and then substitute x = —1 in 
the remaining expression. [Mentally conceal the term (x + 1) in F(x) with a finger and then let x = —1 in the remaining expression.] The steps in 
covering up the function 
F(x) 2x? + 9x — 11 

(x + 1)(x — 2)(x +3) 


are as follows. 


Step 1. Cover up (conceal) the factor (x + 1) from F(x): 


2x? ++ 9x — 11 


(D(x — 2)(x +3) 
Step 2. Substitute x = —1 in the remaining expression to obtain k,: 
oS ee 

1 (-1=2)(-14+3) 6 


Similarly, to compute kz, we cover up the factor (x — 2) in F(x) and let x = 2 in the remaining function, as follows: 


b= 2x? + 9x —11 _ 8+18-1 _5_, 
(x + 1) x +3)hn2 (241243) 15 

and 

= 2x7+9x -11 a 18-27-11 oe 

"(x +1)(x — 2) BP. | (3 + 1-3-2) 10 

Therefore, , 

F(x) = 2x* + 9x —11 a 


Complex Factors Of Q(x) 


The procedure just given works regardless of whether the factors of Q(x) are real or complex. Consider, for example, 


4x? + 2x +18 
(x + 1)(x? + 4x + 13) 
4x7 +2x +18 
(x + I(x +2 —j3)(4 +24 73) 
ky ky ky 


SS 
x+1 %x4+2-j3 x*+24+]3 


F(x) = 


(B.38) 


where 


4x? 1 
k= _ 4x +2x+18 = 


WR (x? + 4x + 13)) 


Similarly, 
4x? + 2x +18 


ky = | =e 
(x + |) BY (x + 2 + 73) 
4x? +2x +18 


@+)e+2-/) 


Therefore, 


x=—-2+j3 


xu—2-j3 


; 2 J5ei343" Je jo3.43° 
WG) sy1 340-8  xe2ee (B.39) 
The coefficients kp and k3 corresponding to the complex conjugate factors are also conjugates of each other. This is generally true when the 
coefficients of a rational function are real. In such a case, we need to compute only one of the coefficients. 
Quadratic Factors 


Often we are required to combine the two terms arising from complex conjugate factors into one quadratic factor. For example, F(x) in Eq. (B.38) can 
be expressed as 


F(x) = 4x? + 2x +18 _ ky C\X + C2 
~ (x+1)(x?+4x413) x41 x2?4+4x413 


The coefficient k; is found by the Heaviside method to be 2. Therefore, 


4x7 + 2x +18 2 CX + C2 


a a eS B.40 
(x+1)(x2?+4x4+13) x41 x24+4x4+13 ( ) 


The values of c, and cz are determined by clearing fractions and equating the coefficients of similar powers of x on both sides of the resulting 
equation. Clearing fractions on both sides of 
Eq. (B.40) yields 
4x? + 2x + 18 = 2(x? + 4x + 13) + (Cre + 02)(4 +1) 
= (2+ e:)x? + (8 + ¢1 + c2)x + (26 + 2) (B41) 


Equating terms of similar powers yields c1 = 2, cp = —8, and 


4x7 + 2x + 18 _ 2 4 2x —8 (BA2) 
(x+ D(x? 4+4x4+13) x+1 x27 4+4x4+13 — 
SHORTCUTS 


The values of cy and co in Eq. (B.40) can also be determined by using shortcuts. After computing k; = 2 by the Heaviside method as before, we let 
X = 0 on both sides of Eq. (B.40) to eliminate c;. This gives us 


18 C2 
pn ?tp 
Therefore, 
a= —§8 


To determine c;, we multiply both sides of Eq. (B.40) by x and then let x — oo. Remember that when x — o9, only the terms of the highest power 
are significant. Therefore, 


4=2+¢ 
and 
C, =2 


In the procedure discussed here, we let x = 0 to determine cz and then multiply both sides by x and let x — o to determine c,. However, nothing is 
sacred about these values (x = 0 or x = o). We use them because they reduce the number of computations involved. We could just as well use 


other convenient values for x, such as x = 1. Consider the case 
2x? +4x4+5 

F(x) ee 

x(x? + 2x +5) 

k CX + C2 


of a 
x x7+2x4+5 


We find k = 1 by the Heaviside method in the usual manner. As a result, 


2x? + 4x +5 I ax+te 
x(x?+2x+5) x x?+2x+5 


To determine c1 and Co, if we try letting x = 0 in Eq. (B.43), we obtain oo on both sides. So let us choose x = 1. This yields 


11 C1) + C2 
oki, YS 
8 $ 8 
or 

Oto=3 


We can now choose some other value for x, such as x = 2, to obtain one more relationship to use in determining c, and co. In this case, however, a 
simple method is to multiply both sides of Eq. (B.43) by x and then let x — oo. This yields 


2=1 +c 
so that 
a=] and G=2 
Therefore, 
l x+2 
F(x) = -+ —————; 
x x742x4+5 


B.5-3 Repeated Factors of Q(x) 


If a function F(x) has a repeated factor in its denominator, it has the form 


PC: 
(0 ——— (B.44) 
(x —A)F(x —ay)(x — a2) +++ (xX — ay) 


Its partial fraction expansion is given by 


& ay G1 
Fa i ee ee EOP yet a 
= Gay *aoa “TG 
k ks k 
a (B.45) 
t— Q I—&% Xx -@Q; 


The coefficients k1, k2,..., kj corresponding to the unrepeated factors in this equation are determined by the Heaviside method, as before [Eq. 
(B.37)]. To find the coefficients a9, a1, a9,..., €ar_4, We multiply both sides of Eq. (B.45) by (x — A)". This gives us 


(x — A) F(x) = ay +4,(x — A) +.an(x — A +--+ ta, (x —ay! 

(x —Aay (x — Ay (x — Ay 
j + Ky —— t+ Hh (B.A6) 
— xX—@ i-—-Qs 


If we let x = A on both sides of Eq. (B.46), we obtain 
(x —A)' F(x)|.a. = ao (B.47a) 


Therefore, ag is obtained by concealing the factor (x — A)! in F(x) and letting x = \ in the remaining expression (the Heaviside "cover-up" method). If 
we take the derivative (with respect to x) of both sides of Eq. (B.46), the right-hand side is a, + terms containing a factor (x — A) in their numerators. 
Letting x = A on both sides of this equation, we obtain 


a 
—((z%— ay Fix) =a 
dx 


w= 


Thus, a1 is obtained by concealing the factor (x — A)" in F(x), taking the derivative of the remaining expression, and then letting x = A. Continuing in 
this manner, we find 


1 di 
— —— f(r — AF F(x)] 


= B4 
ji dxi eee 


a; 


rok 


Observe that (x — A)! F(x) is obtained from F(x) by omitting the factor (x — A)! from its denominator. Therefore, the coefficient aj is obtained by 


concealing the factor (x — A)! in F(x), taking the jth derivative of the remaining expression, and then letting x = \ (while dividing by /!). 


EXAMPLE B.10 
Expand F(x) into partial fractions if 


4x3 + 16x* + 23x + 13 
(x + 1)?(% + 2) 
The partial fractions are 
F(x) = — + Sy : 
(x+1)>  (x+1)? x+1  x+2 
The coefficient k is obtained by concealing the factor (x + 2) in F(x) and then substituting x = —2 in the remaining expression: 


_ 40° + 16x? + 23x + 13 


(x +1) DD ‘ 


L=—2 


F(x) = 


To find ag, we conceal the factor (x + 1)? in F(x) and let x = —1 in the remaining expression: 


2 4x3 + 16x? + 23x + 13 
a 
Gmc +> |, 


To find a;, we conceal the factor (x + 1)8 in F(x), take the derivative of the remaining expression, and then let x = —1: 


d |4x>+ 16x? + 23x +13 


Te —s 
‘dx | (RM +2) |}, 


Similarly, 


1 d? | 4x3 + 16x? + 23x + 13 


QF Oe IO" 
* Qtax? | BG +2) || 


Therefore, 


=2 


1 3 1 
(x + 1)3 T (x +1)? a x+1 Ty +2 


F(x) = 


B.5-4 Mixture of the Heaviside "Cover-Up" and Clearing Fractions 


For multiple roots, especially of higher order, the Heaviside expansion method, which requires repeated differentiation, can become cumbersome. For 
a function that contains several repeated and unrepeated roots, a hybrid of the two procedures proves to be the best. The simpler coefficients are 
determined by the Heaviside method, and the remaining coefficients are found by clearing fractions or shortcuts, thus incorporating the best of the 
two methods. We demonstrate this procedure by solving Example B.10 once again by this method. 


In Example B.10, coefficients k and ag are relatively simple to determine by the Heaviside expansion method. These values were found to be ky = 1 

and ao = 2. Therefore, 

4x°+16x7+23x+13 2 a az I 
(x+I3(x+2) (x +1 +a4+D 341 +r42 


We now multiply both sides of this equation by (x + 1)8 (x + 2) to clear the fractions. This yields 
4x? + 16x? + 23x + 13 


= 2(x +2) + ay(x + I(x + 2) tax + I(x +2) + + DP 

= (1 +a2)x° + (a; +4ay + 3)x? + (5S + 3a + Saodx + (4 + 2a; +202 +1) 
Equating coefficients of the third and second powers of x on both sides, we obtain 

l+a=4 a,=1 
= 

a, + 4a. +3 = 16 a= 
We may stop here if we wish because the two desired coefficients, a; and az, are now determined. However, equating the coefficients of the two 
remaining powers of x yields a convenient check on the answer. Equating the coefficients of the x’ and x° terms, we obtain 


23 =5+4+ 3a; + 5a, 
13 = 4+ 2a: +2a.+1 
These equations are satisfied by the values a; = 1 and ag = 3, found earlier, providing an additional check for our answers. Therefore, 


2 I 3 | 
F() = —— + —_——_— 
) (x+1)¥ ely sel x42 


which agrees with the earlier result. 


A MIXTURE OF THE HEAVISIDE "Cover-Up" AND SHORTCUTS 


In Example B.10, after determining the coefficients ag = 2 and k = 1 by the Heaviside method as before, we have 


4x°+16x7+23x+13 2 x, a @ I 
(x+1R(x+2) = (x+18) (x41)? x41 x42 
There are only two unknown coefficients, a, and ag. If we multiply both sides of this equation by x and then let x — o, we can eliminate a,. This 
yields 
4=m@4+1 => m=3 
Therefore, 
ax'+16x'+23x+13_ 2 am 3 Pam. 
(x+Ix+2) = (x+18) (vt)? xt] x42 


There is now only one unknown aj, which can be readily found by setting x equal to any convenient value, say x = 0. This yields 


13 1 
FZ a2tat3t+s => a=l1 


which agrees with our earlier answer. 

There are other possible shortcuts. For example, we can compute ao (coefficient of the highest power of the repeated root), subtract this term from 
both sides, and then repeat the procedure. 

B.5-5 Improper F (x) with m =n 


A general method of handling an improper function is indicated in the beginning of this section. However, for a special case of the numerator and 
denominator polynomials of F(x) being of the same degree (m = n), the procedure is the same as that for a proper function. We can show that for 


b,x" + Dd, xt + ae + bx + bo 
La) = 
X" + pix"! +--+ + aX +a 
ky ky Ky, 
x-A, xX-A, X—An 


the coefficients k;, ko,..., Kk, are computed as if F(x) were proper. Thus, 


k, = (x —1)F(x)lrer, 


For quadratic or repeated factors, the appropriate procedures discussed in Sections B.5-2 or B.5-3 should be used as if F(x) were proper. In other 
words, when m = n, the only difference between the proper and improper case is the appearance of an extra constant b, in the latter. Otherwise the 
procedure remains the same. The proof is left as an exercise for the reader. 


EXAMPLE B.11 


Expand F(x) into partial fractions if 


3x7+9x—20  3x?+9x —20 
4+x-6 (x-—2%+3) 


Here m =n = 2 with by = bo = 3. Therefore, 


3x7+4+x—20 ky ky 


Faye 


F FF ———— CSO 
) (x — 2)(x + 3) +3 e3 
in which 
by = OE 9x=20/  _ 12+ 18-20 _ 10 _, 
(Ber +3! +3 
and 
‘a 3x? + 9x — 20 _ 27-27-20 _-20_, 
 @- 2) 3-2) 
Therefore, , 

3x° + 9x — 20 2 4 
F(x) = = + 


(x —2)(x +3) _ TF 2 x+3 


B.5-6 Modified Partial Fractions 


In finding the inverse z-transforms (Chapter 5), we require partial fractions of the form kx/(x — Aj)" rather than k/(x — j;)". This can be achieved by 
expanding F(x)/x into partial fractions. Consider, for example, 


F(x) = 5x* + 20x + 18 
~ (x +2)(x +3) 


Dividing both sides by x yields 
F(x) 5x? 4+20x +18 


x x(x+2)(x +3) 


Expansion of the right-hand side into partial fractions as usual yields 
F(x) 5x* + 20x + 18 ay a ay ay 


a 
x x(x +2)(x+3)2 39 x+2 (x+3)) (x1 4+3)7 


Using the procedure discussed earlier, we find ay = 1, a2 = 1, a3 = —2, and ag = 1. Therefore, 


Fix) 1, 1 2 1 


- +——; 
Xx x x+2 x+3 (x43) 
Now multiplying both sides by x yields 


F(x) =1+ _ i 
— X4+2 xX4+30 (4 +3) 


This expresses F(x) as the sum of partial fractions having the form kx/(x — Aj)". 


B.6 VECTORS AND MATRICES 


An entity specified by n numbers in a certain order (ordered n-tuple) is an n-dimensional vector. Thus, an ordered n-tuple (x4, X2,..., Xn) represents 
an n-dimensional vector x. A vector may be represented as a row (row vector): 


X=[X1 X2 ++ Xn] 

or as a column (column vector): 
x; 
x2 

xXx= 
Xn 


Simultaneous linear equations can be viewed as the transformation of one vector into another. Consider, for example, the n simultaneous linear 
equations 


Vi = Ay X + Qy2X2 + +++ $F Aiy Xp, 


Y2 = A2X + 22X2 + +++ + Amy Xn 


(B.48) 
Yar = Ami X, + Am2X2 + +++ + AmnXn 
If we define two column vectors x and y as 
x1 MM 
-_ r “a w= e (B.49) 
Xn Yn 


then Eqs. (B.48) may be viewed as the relationship or the function that transforms vector x into vector y. Such a transformation is called the linear 
transformation of vectors. To perform a linear transformation, we need to define the array of coefficients aj appearing in Eqs. (B.48). This array is 


called a matrix and is denoted by A for convenience: 


4, G2 *** Ay 
4 42 *** Gn 

A=]. : ; (B.50) 
Amt Qn? ae Qian 


A matrix with m rows and n columns is called a matrix of the order (m, n) or an (m x n) matrix. For the special case of m = n, the matrix is called a 
Square matrix of order n. 


It should be stressed at this point that a matrix is not a number such as a determinant, but an array of numbers arranged in a particular order. It is 
convenient to abbreviate the representation of matrix A in Eq. (B.50) with the form (aj) m x n, implying a matrix of order m x n with aj as its ith 


element. In practice, when the order m x n is understood or need not be specified, the notation can be abbreviated to (aj). Note that the first index / 
of aj indicates the row and the second index j indicates the column of the element aj in matrix A. 


The simultaneous equations (B.48) may now be expressed in a symbolic form as 


or 
vy Qyy Ayn sain xy 
y2 Qn Qn *** am X2 

._ |= (B.52) 
Ym Omi An? weal 'Gaas Xn 


Equation (B.51) is the symbolic representation of Eq. (B.48). Yet we have not defined the operation of the multiplication of a matrix by a vector. The 
quantity Ax is not meaningful until such an operation has been defined. 


B.6-1 Some Definitions and Properties 


A square matrix whose elements are zero everywhere except on the main diagonal is a diagonal matrix. An example of a diagonal matrix is 


2 0 0 


0 1 0 
0: 0: 5 
A diagonal matrix with unity for all its diagonal elements is called an identity matrix or a unit matrix, denoted by I. This is a square matrix: 
100 =:- 0 
0 10 --. 0 
1=]0 01 - 0 (B.53) 
000 -- 1 


The order of the unit matrix is sometimes indicated by a subscript. Thus, I,, represents the n — n unit matrix (or identity matrix). However, we shall 
omit the subscript. The order of the unit matrix will be understood from the context. 


A matrix having all its elements zero is a zero matrix. 
A square matrix A is a symmetric matrix if aj = aj (symmetry about the main diagonal). 


Two matrices of the same order are said to be equal if they are equal element by element. Thus, if 

A = (4jj) mxa and B= (Bij) mxn 

then A = B only if aj = 6, for all i and j. 

If the rows and columns of an m x n matrix A are interchanged so that the elements in the ith row now become the elements of the ith column (for / 


= 1, 2,..., m), the resulting matrix is called the transpose of A and is denoted by A’. It is evident that A’ is an n x m matrix. For example, if 
? ra | 


A=|3 2 ice de |* 2 
% 2 3 
1 3 
Thus, if 
A= (ij )mxn 
then 
Al = (aja)axm (B.54) 
Note that 
(A')’ =A (B.55) 


B.6-2 Matrix Algebra 


We shall now define matrix operations, such as addition, subtraction, multiplication, and division of matrices. The definitions should be formulated so 
that they are useful in the manipulation of matrices. 


ADDITION OF MATRICES 
For two matrices A and B, both of the same order (m x n), 


4, 2 Gin by Dyn ees On 

Gy Gy ++ Ay by by ++ by 
A=]. : ; and B=]. : 

Ami Amz °°" Amn Doe Dwr t+ Dyan 


we define the sum A + B as 


(44, +6) (diz + Biz) +--+ (Qin + Din) 


(4x, +by) (dae tbhn) +++ (Aa, +d») 
A+B= ; ; ; 


(Qni + Dm) (Qn? + Dm2) she (Amn + Din) 
or 
A+B = (4); + Dij)mexa 
Note that two matrices can be added only if they are of the same order. 


MULTIPLICATION OF A MATRIX BY A SCALAR 


We multiply a matrix A by a scalar c as follows: 


My G2 *** Ata Cay, CAl2 +s CA, 
Gy, G2 +++ Ay Cay, Can +++ Cay, 

cA=c ~ p= : . = Ac 
Ant Am? Ayn Cam) Cam. *** Camn 


We also observe that the scalar c and the matrix A commute, that is, 
cA = Ac 


MATRIX MULTIPLICATION 


We define the product 
AB=C 


in which cj, the element of C in the ith row and jth column, is found by adding the products of the elements of A in the ith row with the 
corresponding elements of B in the jth column. Thus, 


Cy = aid, + ajrb>; a ls GinDn; 


n 
= Sass; (B.S6) 
k=1 
This result is expressed as follows: 
bij 
b2; 
Qi, Giz +++) Gin oats bi; weted Ul tate Cij 
—— Daj ——<—SE ee” 
Ay Cc xp) 
men) Bo... * (mx p 


Note carefully that if this procedure is to work, the number of columns of A must be equal to the number of rows of B. In other words, AB, the 
product of matrices A and B, is defined only if the number of columns of A is equal to the number of rows of B. If this condition is not satisfied, the 
product AB is not defined and is meaningless. When the number of columns of A is equal to the number of rows of B, matrix A is said to be 
conformable to matrix B for the product AB. Observe that if A is an m x n matrix and B is ann x p matrix, A and B are conformable for the product, 
and C is an m x p matrix. 


We demonstrate the use of the rule in Eq. (B.56) with the following examples. 
Zz 3 1312 8 9 3 7 
Dita ans #2 3 
44 5 10 4 7 
2 
[2 1 3]]1] =8 
1 


In both cases, the two matrices are conformable. However, if we interchange the order of the matrices as follows, 


2 3 
Pe aati 


2449 
3 4 
the matrices are no longer conformable for the product. It is evident that in general, 
ABBA (B.57) 


Indeed, AB may exist and BA may not exist, or vice versa, as in our examples. We shall see later that for some special matrices, AB = BA. When 


this is true, matrices A and B are said to commute. We reemphasize that in general, matrices do not commute. 


In the matrix product AB, matrix A is said to be postmultiplied by B or matrix B is said to be premultiplied by A. We may also verify the following 
relationships: 


(A+B)C =AC+BC (B.58) 
C(A + B) = CA + CB (B.59) 

We can verify that any matrix A premultiplied or postmultiplied by the identity matrix | remains unchanged: 
AI=IA=A (B.60) 


Of course, we must make sure that the order of I is such that the matrices are conformable for the corresponding product. 
We give here, without proof, another important property of matrices: 

|AB| = |A||B| (B.61) 
where |A| and |B] represent determinants of matrices A and B. 


MULTIPLICATION OF A MATRIX BY A VECTOR 

Consider the matrix Eq. (B.52), which represents Eq. (B.48). The right-hand side of Eq. (B.52) is a product of the m x n matrix A and a vector x. If, 
for the time being, we treat the vector x as if it were an n x 1 matrix, then the product Ax, according to the matrix multiplication rule, yields the right- 
hand side of Eq. (B.48). Thus, we may multiply a matrix by a vector by treating the vector as if it were an n x 1 matrix. Note that the constraint of 
conformability still applies. Thus, in this case, xA is not defined and is meaningless. 


MATRIX INVERSION 


To define the inverse of a matrix, let us consider the set of equations represented by Eq. (B.52): 


a a, @2 +s An x; 
y2 43 42 *'* Gy *2 

= (B.62a) 
Yn Gn} An? sai Gag Xn 


We can solve this set of equations for x4,X2,...,Xp7 in terms of y1, y2,..-, Yn, by using Cramer's rule [see Eq. (B.31)]. This yields 


IDul Wal [Dal 
|A| |A| |A| 
1 Dio} [Dz2} Dra | 


AY «(Ay ti“‘«é‘SAACSSCSdS;CC (B.62b) 


IDi,| |Do,| _— IDan| 
|A| |A| |Al 


in which |A| is the determinant of the matrix A and |Djj| is the cofactor of element aj in the matrix A. The cofactor of element aj is given by (—1)4 
times the determinant of the (n — 1) x (n — 1) matrix that is obtained when the ith row and the jth column in matrix A are deleted. 


We can express Eq. (B.62a) in matrix form as 
y= Ax (B.63) 

We now define A~", the inverse of a square matrix A, with the property 
A'A=I (unit matrix) (B.64) 


Then, premultiplying both sides of Eq. (B.63) by A~', we obtain 
A'‘y=A'Ax=Ik=x 


or 
z= Aqty (B.65) 
A comparison of Eq. (B.65) with Eq. (B.62b) shows that 
IDul [Dal --- [Dal 
' 1 | !Del Del --- |Dy2! —_ 
eb oe : (B. 
|A| ss 
Dial D2. pase © Dun! 


One of the conditions necessary for a unique solution of Eq. (B.62a) is that the number of equations must equal the number of unknowns. This 


implies that the matrix A must be a square matrix. In addition, we observe from the solution as given in Eq. (B.62b) that if the solution is to exist, |A| 


+ 0!T] Therefore, the inverse exists only for a square matrix and only under the condition that the determinant of the matrix be nonzero. A matrix 
whose determinant is nonzero is a nonsingular matrix. Thus, an inverse exists only for a nonsingular, square matrix. By definition, we have 


A'A=I (B.67a) 
Postmultiplying this equation by A~' and then premultiplying by A, we can show that 
AA-' =I (B.67b) 


Clearly, the matrices A and A~' commute. 


The operation of matrix division can be accomplished through matrix inversion. 


EXAMPLE B.12 
Let us find AW’ if 


23 3 4 
A=(|/1 2 3 

3.2 4 
Here 
|ID;;| = —4, IDi2| = 8, |D,3| = —4 
ID2| = 1, |D»| = —1, |Dx3| = —1 
[Ds] = 1, |D32| = —5, ID33| = 3 
and |A| = —4. Therefore, 
Atv= 2 8 -l -5 

—§ -1. 3 


B.6-3 Derivatives and Integrals of a Matrix 


Elements of a matrix need not be constants; they may be functions of a variable. For example, if 


e-* sin f 
a=|% Bsa ee) 


then the matrix elements are functions of t. Here, it is helpful to denote A by A(t). Also, it would be helpful to define the derivative and integral of 
A(t). 


The derivative of a matrix A(t) (with respect to t) is defined as a matrix whose jjth element is the derivative (with respect to ft) of the jth element of 
the matrix A. Thus, if 
A(t) = [aij (2) mn 


then 

d d 

—[A(t)] = |—a;\(t B.69a 
or 

A(t) = [4:;(OImxn (B.69b) 
Thus, the derivative of the matrix in Eq. (B.68) is given by 
rv —2e-% cos f 

=| -e'-—2e% 


Similarly, we define the integral of A(t) (with respect to f) as a matrix whose jth element is the integral (with respect to ft) of the jth element of the 
matrix A: 


[awa = ( f aar) (B.70) 


Thus, for the matrix A in Eq. (B.68), we have 


2 ‘ 
[awmar= [Fe dt f sin dt 


fedt fl(e'+2e)dt 


We can readily prove the following identities: 


d dA dB 


se te) et (B.7 1a) 

d dA 

—(cA) = c— B.71b 

dt aa toes dt ( 

d 1A iB F 

—(AB) = —B+A— =AB+AB (B.71c) 

dt dt dt 
The proofs of identities (B.71a) and (B.71b) are trivial. We can prove Eq. (B.71c) as follows. Let A be an m x n matrix and B an n x p matrix. Then, if 
C=A 


from Eq. (B.56), we have 
na 


Cik = ». AijDjx 
j=l 


and 
n n 
Ck = SY aijbju + > Aj jDjx (B.72) 
j=l j=) 
—_—_—— _—_—_——— 
dit ix 
or 


Cj = dij + Cin 


Equation (B.72) along with the multiplication rule clearly indicate that dj, is the ikth element of matrix AB and e;, is the ikth element of matrix AB 
Equation (B.71c) then follows. 


If we let B = A“ in Eq. (B.71c), we obtain 
d dA d 
—(AA™') = —A'+A—A™! 


dt dt dt 
But since 
d d 
—(AA™') = —I= 
Th dt v 
we have 
@ 4-1, _ _,-;4A,_, 
a )=-A a (B.73) 


B.6-4 The Characteristic Equation of a Matrix: The Cayley-Hamilton Theorem 


For an (n — n) square matrix A, any vector x (x + 0) that satisfies the equation 


Ax = Ax (B.74) 
is an eigenvector (or characteristic vector), and is the corresponding eigenvalue (or characteristic value) of A. Equation (B.74) can be expressed as 
(A —ADx=0 (B.75) 
The solution for this set of homogeneous equations exists if and only if 
A —Al| = |AI-— A] =0 (B.76a) 
or 
Ghi= X 412 Ain 
4 @n-h A 
; =0 (B,76b) 
Any An2 ss ‘ta = A 


Equation (B.76a) [or (B.76b)] is known as the characteristic equation of the matrix A and can be expressed as 


Q(A) = |AL— Al =A" + ay?! +++ tad tad’ =0 (B.77) 


Q(A) is called the characteristic polynomial of the matrix A. The n zeros of the characteristic polynomial are the eigenvalues of A and, corresponding 
to each eigenvalue, there is an eigenvector that satisfies Eq. (B.74). 


The Cayley-Hamilton theorem states that every n x n matrix A satisfies its own characteristic equation. In other words, Eq. (B.77) is valid if X. is 
replaced by A: 


Q(A) = A® + aA") +--+ + aA +aA° =0 (B.78) 
FUNCTIONS OF A MATRIX 
We now demonstrate the use of the Cayley-Hamilton theorem to evaluate functions of a square matrix A. 
Consider a function f(A) in the form of an infinite power series: 
oo 
f(A) = Bot BA + BAZ +. $e =O Ba (B.79) 
int 
Since i, being an eigenvalue (characteristic root) of A, satisfies the characteristic equation [Eq. (B.77)], we can write 
MY = yk — dg"? — +++ ah — do (B.80) 


If we multiply both sides by A, the left-hand side is ”*", and the right-hand side contains the terms A”, "1, ..., A. Using Eq. (B.80), we substitute 
2X", in terms of X”—1, 27-2... \ so that the highest power on the right-hand side is reduced to n — 1. Continuing in this way, we see that \”** can 
be expressed in terms of Reel nh for any k. Hence, the infinite series on the right-hand side of Eq. (B.79) can always be expressed in terms of 
7-1 7-2-0, and a constant as 


F(A) = Bo + Bid + Bx? +--+ + Bad (B81) 


If we assume that there are n distinct eigenvalues ?4, ?2,..., Aj, then Eq. (B.81) holds for these n values of \. The substitution of these values in Eq. 
(B.81) yields n simultaneous equations 


f(a) LA AE ss AF Bo 
S (Ad) 1 A. Ag: ay B; 
: mis = 1s : : (B.82a) 
Sn) 1 Ap A? --- al] LB 
an 
‘ -1 
. pe i fu) 
de 2B wee ge? f(a) 
(B.82b) 
ys-} San) 


Since A also satisfies Eq. (B.80), we may advance a similar argument to show that if f(A) is a function of a square matrix A expressed as an infinite 
power series in A, then 


f(A) = Bol + BA + BA? +--- +--+ = SO BAT (B.83a) 


ial 
and, as argued earlier, the right-hand side can be expressed using terms of power less than or equal ton — 1, 
S(A) = Bol + BA + BA? +--- + Bp A™™ (B.83b) 
in which the coefficients Bjs are found from Eq. (B.82b). If some of the eigenvalues are repeated (multiple roots), the results are somewhat modified. 


We shall demonstrate the utility of this result with the following two examples. 
B.6-5 Computation of an Exponential and a Power of a Matrix 
Let us compute eAt defined by 


A??? At" 
M sltart +. a 


+ eee 
A‘rt 


k=0 


From Eq. (B.83b), we can express 
e! = oF B (Ay 
i=1 
in which the B;s are given by Eq. (B.82b), with f(A;) = ed”. 


EXAMPLE B.13 
Let us consider 


ane 


The characteristic equation is 


Al— Al = - yy [=e +342 (+ 1)A+2)=0 
Hence, the eigenvalues are Ay = —1, Ag = —2, and 

= Pol + BiA 
in which 


fo) _Ji -1 
il 2 


A = 004-6) 1] tere) | 2 A 


_ | wimg * (et po] 
~ [—Qe +2e-4  -—e* + 2e-% 


COMPUTATION OF AK 


As Eq. (B.83b) indicates, we can express AX as 


A* = B+ BA+--:+B,1A"” 


in which the Bjs are given by Eq. (B.82b) with f(A;) = MM. For a completed example of the computation of AK by this method, see Example 10.12. 


[tlThese two conditions imply that the number of equations is equal to the number of unknowns and that all the equations are independent. 


B.7 MISCELLANEOUS 


B.7-1 L'H6pital’s Rule 


If lim f(x)/g(x) results in the indeterministic form 0/0 or oo/co, then 
im 2 © (x) = Yi f(x) 
mg) 8(x) 


B.7-2 The Taylor and Maclaurin Series 


& fay 4 Raise 


f(x) = fla)t+ 
(X= fO+ 5 =fO+> - 70) +: 


B.7-3 Power Series 


x? x? x* 
Caltrtatayt ta 
2 x 
esa at mt 
; a Oe 3 
cosx=1 a mate <r 
3 2x3 17x? — 
= 4 
lan x rt7tT5 315 Sate ae, wf 
x et 8ix? ee 
a Sat sh ee ae spss 4 
tanh x = x 3+ 315 2 nf 


- —I(n-2 
tata Lenn Ma MP gn (Mate 


3! 


= 1l+nx l<«l 
1 


pay tet tte ict 
B.7-4 Sums 
a re 1_oypm 
-_ 1 
ar ——4 rf 
We n(n +1) 
tet 2 
Ly 1)(2n + 1) 
&-0 6 
a an ae: +1 
yp ae r#l 
k=0 (r-1) 
er _ ld +r) =r") — 2nd —r)r* — rr") 
rears ve a—ry 


B.7-5 Complex Numbers 
erinl2 = +j 


gtinn _ I neven 
~ |—1 nodd 


e*/® =cos@+ jsin 

a+jb=re® r=Va?+b,6 =tan" (2) 
(rei?) = rk ike 

(rie!) (rye/®) is ryrzel at) 


B.7-6 Trigonometric Identities 


rx#l 


e*/* = cos x + j sin x 
cos x = $[e/* + e-/*] 
sin xX = qle* — e7J*) 
cos (x + >) = Fsin x 
sin (x + 5) = cos x 
2sin x cos x = sin 2x 
sin? x + cos?x = 1 
cos’ x — sin’ x = cos 2x 
cos* x = 3(1 + cos 2x) 
sin? x = 4(1 — cos 2x) 


cos* x = 4(3cos x + cos 3x) 

sin’ x = }(3sin x — sin 3x) 

sin (x + y) = sin xcos y+ cos x sin y 
cos (x + y) = cos x cos y F sin x sin y 
tan x +tan y 

1 F tan xtany 

sin x sin y = $[cos(x — y) — cos(x + y)] 


tan(x ty) = 


cos x cos y = [cos (x — y) + cos(x + y)] 
sin x cos y = 3[sin (x — y) + sin(x + y)] 


acos x + bsin x = C cos (x + 4) C = Va? + b?,@ = tan“ (=) 


B.7-7 Indefinite Integrals 


[ude =we- f va 


/ S(x)a(x) dx = f(x)g(x) - / S(x)g(x) dx 


: 1 1. 
sin ax dx = —— cos ax cos axdx = — sin ax 


[ sw®axax et J costaxdx a eee 
"2 4a ~ 2° 4a 


1 
[xsin ax dx = =>(sin ax — ax cos ax) 
1 : 
[ x00s ax dx = Gi (cos ax + ax sin ax) 
1 
[sin ax dx = qr l2ax sin ax +2cos ax — a°x* cos ax) 


1 . P 
[* cos ax dx = Ga (ax cos ax —2sin ax + a*x* sin ax) 


. : _ sin(a@—b)x — sin(a+b)x ai icat 
[ sin axsin bx dx = 2a —b) a +b) a’ tb 
; _ _feos(a—b)x | cos(a+b)x errr 
[ sin axcos bx a “ae Y aa ab 
_ sin(a—b)x | sin(a +b)x re 
[00s ax 00s bx dx = Xa ab) a+b a #b 


[oaate 
a 
[retar=Sar-1 
a 
20x em 58 
[vea= Ser — 2ax +2) 
[essin bx dx = apasin bx — bcos bx) 


fe cos bx dx = (acos bx + bsin bx) 


e™* 
a+b 
I 1 
| aparece = 
x?+@ a a 
x _ 1 2 2 
[perme rey 


B.7-8 Common Derivative Formulas 


d d du 
at) = IMR 


(uv) je + Rasa 
d dx dx 
d (+) _ vt — ye 
dx\v/) — v? 
ax" at 
rE nx 
d 
i eee 
dx ae) 
<log(ar) = lose 
d b. 
—e™* =p bx 
ae e€ 
d 
—a’* = b(Ina)a™ 
dx 
a 
— sin ax = acos ax 
dx 
d . 
— cos ax = —a sin ax 
dx 
nm " cos? ax 
Ese ax) = a 
dx V1 — ax? 
é (cos! ax) = = 
dx J1— ax? 
ad (tan ax) = a 
dx ~ 1+a2x? 


B.7-9 Some Useful Constants 


m *% 3.1415926535 
e = 2.7182818284 
1 
e 


= 0.3678794411 


logy 2 = 0.30103 
log) 3 = 0.47712 


B.7-10 Solution of Quadratic and Cubic Equations 


Any quadratic equation can be reduced to the form 
ax? +bx+c=0 
The solution of this equation is provided by 
__ —b+ Jb? —4ac 
i= — = 
A general cubic equation 
y+py +ay+r=0 
may be reduced to the depressed cubic form 
xw+ax+b=0 
by substituting 


jage 
y= 3 


This yields 
=33q¢-p°) b= 4(2p*-9pq +271) 


Now let 


The solution of the depressed cubic is 


Xx=A+B, pect She x= Le el A 
and 
Pp 
2 
, 3 
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MATLAB SESSION B: ELEMENTARY OPERATIONS 


MB.1 MATLAB OVERVIEW 


Although MATLAB(r) (a registered trademark of The Math Works, Inc.) is easy to use, it can be intimidating to new users. Over the years, MATLAB 
has evolved into a sophisticated computational package with thousands of functions and thousands of pages of documentation. This section provides 
a brief introduction to the software environment. 


When MATLAB is first launched, its command window appears. When MATLAB is ready to accept an instruction or input, a command prompt (>>) is 
displayed in the command window. Nearly all MATLAB activity is initiated at the command prompt. 


Entering instructions at the command prompt generally results in the creation of an object or objects. Many classes of objects are possible, including 


functions and strings, but usually objects are just data. Objects are placed in what is called the MATLAB workspace. If not visible, the workspace can 
be viewed in a separate window by typing workspace at the command prompt. The workspace provides important information about each object, 
including the object's name, size, and class. 


Another way to view the workspace is the whos command. When whos is typed at the command prompt, a summary of the workspace is printed in 
the command window. The who command is a short version of whos that reports only the names of workspace objects. 


Several functions exist to remove unnecessary data and help free system resources. To remove specific variables from the workspace, the clear 
command is typed, followed by the names of the variables to be removed. Just typing clear removes all objects from the workspace. Additionally, 
the clc command clears the command window, and the clf command clears the current figure window. 


Often, important data and objects created in one session need to be saved for future use. The save command, followed by the desired filename, 
saves the entire workspace to a file, which has the .mat extension. It is also possible to selectively save objects by typing save followed by the 
filename and then the names of the objects to be saved. The load command followed by the filename is used to load the data and objects 
contained in a MATLAB data file (.mat file). 


Although MATLAB does not automatically save workspace data from one session to the next, lines entered at the command prompt are recorded in 
the command history. Previous command lines can be viewed, copied, and executed directly from the command history window. From the command 
window, pressing the up or down arrow key scrolls through previous commands and redisplays them at the command prompt. Typing the first few 
characters and then pressing the arrow keys scrolls through the previous commands that start with the same characters. The arrow keys allow 
command sequences to be repeated without retyping. 


Perhaps the most important and useful command for new users is help. To learn more about a function, simply type help followed by the function 
name. Helpful text is then displayed in the command window. The obvious shortcoming of help is that the function name must first be known. This is 
especially limiting for MATLAB beginners. Fortunately, help screens often conclude by referencing related or similar functions. These references are 
an excellent way to learn new MATLAB commands. Typing help help, for example, displays detailed information on the help command itself and 
also provides reference to relevant functions such as the lookfor command. The lookfor command helps locate MATLAB functions based on a 
keyword search. Simply type lookfor followed by a single keyword, and MATLAB searches for functions that contain that keyword. 


MATLAB also has comprehensive HTML-based help. The HTML help is accessed by using MATLAB's integrated help browser, which also functions 
as a standard web browser. The HTML help facility includes a function and topic index as well as full text-searching capabilities. Since HTML 
documents can contain graphics and special characters, HTML help can provide more information than the command-line help. With a little practice, 
MATLAB makes it very easy to find information. 


When MATLAB graphics are created, the print command can save figures in a common file format such as postscript, encapsulated postscript, 
JPEG, or TIFF. The format of displayed data, such as the number of digits displayed, is selected by using the format command. MATLAB help 
provides the necessary details for both these functions. When a MATLAB session is complete, the exit command terminates MATLAB. 


MB.2 Calculator Operations 


MATLAB can function as a simple calculator, working as easily with complex numbers as with real numbers. Scalar addition, subtraction, 
multiplication, division, and exponentiation are accomplished using the traditional operator symbols +, —, x, +, and “. Since MATLAB predefines i = j 
= ,/—1, a complex constant is readily created using cartesian coordinates. For example, 


>> z = -3-j*4 
Z = -3.0000 - 4.0000i 


assigns the complex constant —3 — /4 to the variable z. 


The real and imaginary components of z are extracted by using the real and imag operators. In MATLAB, the input to a function is placed 
parenthetically following the function name. 


>> z_real = real(z); zZ_imag = imag(z); 


When a line is terminated with a semicolon, the statement is evaluated but the results are not displayed to the screen. This feature is useful when 
one is computing intermediate results, and it allows multiple instructions on a single line. Although not displayed, the results z_real = —3 and 
z_imag = —4 are calculated and available for additional operations such as computing |z|. 


There are many ways to compute the modulus, or magnitude, of a complex quantity. Trigonometry confirms that z = —3 — j4, which corresponds to a 
3-4-5 triangle, has modulus lz] = |-3 — f4] = V/(—3)* + (—4)* = 5. the MATLAB sqrt command provides one way to compute the 
required square root. 


>> z_mag = sqrt(z_real42 + z_imag‘’2) 
zZ_mag = 5 


In MATLAB, most commands, include sqrt, accept inputs in a variety of forms including constants, variables, functions, expressions, and 
combinations thereof. 


The same result is also obtained by computing \z| = 22". In this case, complex conjugation is performed by using the conj] command. 
>> z_mag = sqrt(z*conj(z)) 
z_mag = 5 


More simply, MATLAB computes absolute values directly by using the abs command. 


>> z_mag = abs(z) 
z_mag = 5 


In addition to magnitude, polar notation requires phase information. The angle command provides the angle of a complex number. 


>> z_rad = 5 angie) 
Z _mad = -2.2143 


MATLAB expects and returns angles in a radian measure. Angles expressed in degrees require an appropriate conversion factor. 


>> z_deg = angle(z)*180/pi 
z mad = 126.8699 


Notice, MATLAB predefines the variable pi = TT 


It is also possible to obtain the angle of z using a two-argument arc-tangent function, atan2. 


>> z_deg = atan(z_imag, z_real) 
z_rad = -2.2143 


Unlike a single-argument arctangent function, the two-argument arctangent function ensures that the angle reflects the proper quadrant. MATLAB 
supports a full complement of trigonometric functions: standard trigonometric functions cos, sin, tan; reciprocal trigonometric functions sec, csc, 
cot; inverse trigonometric functions acos, asin, atan, asec, acsc, acot; and hyperbolic variations cosh, sinh, tanh, sech, csch, coth, 
acosh, asinh, atanh, asech, acsch, and acoth. Of course, MATLAB comfortably supports complex arguments for any trigonometric function. As 
with the angle command, MATLAB trigonometric functions utilize units of radians. 


The concept of trigonometric functions with complex-valued arguments is rather intriguing. The results can contradict what is often taught in 
introductory mathematics courses. For example, a common claim is that |cos(x)| < 1. While this is true for real x, it is not necessarily true for 
complex x. This is readily verified by example using MATLAB and the cos function. 


>> cos(j) 
ans = 1.5431 


Problem B.19 investigates these ideas further. 


Similarly, the claim that it is impossible to take the logarithm of a negative number is false. For example, the principal value of In(—1) is ft, a fact 
easily verified by means of Euler's equation. In MATLAB, base-10 and base-e logarithms are computed by using the log10 and log commands, 
respectively. 


>> log( -1) 
ans = 0 + 3.14161 


MB.3 Vector Operations 


The power of MATLAB becomes apparent when vector arguments replace scalar arguments. Rather than computing one value at a time, a single 
expression computes many values. Typically, vectors are classified as row vectors or column vectors. For now, we consider the creation of row 
vectors with evenly spaced, real elements. To create such a vector, the notation a: b: c is used, where a is the initial value, b designates the step 
size, and c is the termination value. For example, 0: 2: 11 creates the length-6 vector of even-valued integers ranging from 0 to 10. 

>> k = 0:2:11 

k=0246 8 10 


In this case, the termination value does not appear as an element of the vector. Negative and noninteger step sizes are also permissible. 


>> k = 11:-10/3:00 
k = 11.0000 7.6667 4.3333 1.0000 


If a step size is not specified, a value of one is assumed. 


>> k = 0:11 
k=0123456789 10 411 


Vector notation provides the basis for solving a wide variety of problems. 


For example, consider finding the three cube roots of minus one, we = —1 = el + 2m1k) for integer k. Taking the cube root of each side yields w = 


el(/3+2nk/3) To find the three unique solutions, use any three consecutive integer values of k and MATLAB's exp function. 


>> k 0: 
>> WwW eee apere + 2*pi*k/3)) 
w = 0.5000 + ©0.8660i -1.0000 + 0.00001 0.5000 - 0.8660i 


iT] 


The solutions, particularly w = — 1, are easy to verify. 


Finding the 100 unique roots of w199 = 


>> k 
>> w 


—1 is just as simple. 


Wil 


0:99; 
exp(j*(pi/100 + 2*pi*k/100)); 


A semicolon concludes the final instruction to suppress the inconvenient display of all 100 solutions. To view a particular solution, the user must 


specify an index. In MATLAB, ascending positive integer indices specify particular vector elements. For example, the fifth element of w is extracted 
using an index of 5. 


>> w(5) 
ans = 0.9603 + 0.27901 


Notice that this solution corresponds to k = 4. The independent variable of a function, in this case k, rarely serves as the index. Since k is also a 
vector, it can likewise be indexed. In this way, we can verify that the fifth value of k is indeed 4. 


>> k(5) 
ans = 4 


It is also possible to use a vector index to access multiple values. For example, index vector 98:100 identifies the last three solutions corresponding 
to k = [97,98,99]. 


>> w(98:100) 
ans = 0.9877 - 0.15641 0.9956 - 0.09411 0.9995 - 0.03141 


Vector representations provide the foundation to rapidly create and explore various signals. Consider the simple 10 Hz sinusoid described by f(t) = 
sin(2Tr 10¢ + 11/6). Two cycles of this sinusoid are included in the interval 0 < t < 0.2. A vector ft is used to uniformly represent 500 points over this 
interval. 


>> t = 0:0.2/500:0.2-0.2/500; 


Next, the function f(t) is evaluated at these points. 
>> f = sin(2*pi*10*t+pi/6); 


The value of f(t) at t = 0 is the first element of the vector and is thus obtained by using an index of one. 


>> f(1) 
ans = 0.5000 


Unfortunately, MATLAB's indexing syntax conflicts with standard equation notation.{T] That is, the MATLAB indexing command f(1) is not the same 
as the standard notation f(1) = f()|4 = 4. Care must be taken to avoid confusion; remember that the index parameter rarely reflects the independent 
variable of a function. 


MB.4 Simple Plotting 


MATLAB's plot command provides a convenient way to visualize data, such as graphing f(t) against the independent variable t. 
>> plot(t, f); 


Axis labels are added using the xlabel and ylabel commands, where the desired string must be enclosed by single quotation marks. The result is 
shown in Fig. MB.1. 


>> xlabel('t'); ylabel('f(t)') 


fi) 


0 0.04 0.08 0.12 0.16 0).2 
t 
Figure MB.1: f(t) = sin (21 10¢ + 11/6). 


The title command is used to add a title above the current axis. 


By default, MATLAB connects data points with solid lines. Plotting discrete points, such as the 100 unique roots of w100 = _4, is accommodated by 
supplying the plot command with an additional string argument. For example, the string 'o' tells MATLAB to mark each data point with a circle 


rather than connecting points with lines. A full description of the supported plot options is available from MATLAB's help facilities. 
>> plot(real(w),imag(w),'0'); 


>> xlabel(' Bes ylabel('Im(w)'); 
>> axis equal 
The axis equal command ensures that the scale used for the horizontal axis is equal to the scale used for the vertical axis. Without axis 


equal, the plot would appear elliptical rather than circular. Figure MB.2 illustrates that the 100 unique roots of w'00 = _4 lie equally spaced on the 
unit circle, a fact not easily discerned from the raw numerical data. 
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Figure MB.2: Unique roots of w19° = —1. 


MATLAB also includes many specialized plotting functions. For example, MATLAB commands semilogx, semilogy, and loglog operate like the 
plot command but use base-10 logarithmic scales for the horizontal axis, vertical axis, and the horizontal and vertical axes, respectively. 
Monochrome and color images can be displayed by using the image command, and contour plots are easily created with the contour command. 
Furthermore, a variety of three-dimensional plotting routines are available, such as plot3, contour3, mesh, and surf. Information about these 
instructions, including examples and related functions, is available from MATLAB help. 


MB.5 Element-by-Element Operations 


Suppose a new function h(t) is desired that forces an exponential envelope on the sinusoid f(t), h(t) = f(t)g(t) where g(t) = e 10f. First, row vector g(t) 
is created. 


>> g = exp(-10*t); 


Given MATLAB's vector representation of g(t) and f(t), computing h(t) requires some form of vector multiplication. There are three standard ways to 
multiply vectors: inner product, outer product, and element-by-element product. As a matrix-oriented language, MATLAB defines the standard 
multiplication operator * according to the rules of matrix algebra: the multiplicand must be conformable to the multiplier. A 1 x N row vector times an 
N x 1 column vector results in the scalar-valued inner product. An N x 1 column vector times a 1 x M row vector results in the outer product, which 
is an N x M matrix. Matrix algebra prohibits multiplication of two row vectors or multiplication of two column vectors. Thus, the * operator is not used 


to perform element-by-element multiplication. 11 


Element-by-element operations require vectors to have the same dimensions. An error occurs if element-by-element operations are attempted 
between row and column vectors. In such cases, one vector must first be transposed to ensure both vector operands have the same dimensions. In 
MATLAB, most element-by-element operations are preceded by a period. For example, element-by-element multiplication, division, and 
exponentiation are accomplished using. *,. /, and .~, respectively. Vector addition and subtraction are intrinsically element-by-element operations and 
require no period. Intuitively, we know h(t) should be the same size as both g(t) and f(t). Thus, h(t) is computed using element-by-element 
multiplication. 


>> h = f.*g; 


The plot command accommodates multiple curves and also allows modification of line properties. This facilitates side-by-side comparison of 
different functions, such as h(t) and f(t). Line characteristics are specified by using options that follow each vector pair and are enclosed in single 
quotes. 


>> plot(t, f,'-k',t,h,' 
>> Rlabel( t'); ylabei(' inmpLicude’ ); 
>> legend('f(t)', 'h(t)' 


Here, '-k' instructs MATLAB to plot f(t) using a solid black line, while ': k' instructs MATLAB to use a dotted black line to plot h(t). A legend and axis 
labels complete the plot, as shown in Fig. MB.3. It is also possible, although more cumbersome, to use pull-down menus to modify line properties 
and to add labels and legends directly in the figure window. 
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Figure MB.3: Graphical comparison of f(t) and h(t). 
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MB.6 Matrix Operations 


Many applications require more than row vectors with evenly spaced elements; row vectors, column vectors, and matrices with arbitrary elements are 
typically needed. 


MATLAB provides several functions to generate common, useful matrices. Given integers m, n, and vector x, the function eye(m) creates the m x m 
identity matrix; the function ones(m,n) creates the m x n matrix of all ones; the function zeros (m,n) creates the m x n matrix of all zeros; and the 
function diag(x) uses vector x to create a diagonal matrix. The creation of general matrices and vectors, however, requires each individual element 
to be specified. 


Vectors and matrices can be input spreadsheet style by using MATLAB's array editor. This graphical approach is rather cumbersome and is not often 
used. A more direct method is preferable. 


Consider a simple row vector r, 


r=[1 0 0] 
The MATLAB notation a: b: c cannot create this row vector. Rather, square brackets are used to create r. 


>> r = [1 0 0] 
r=100 


Square brackets enclose elements of the vector, and spaces or commas are used to separate row elements. 


Next, consider the 3 x 2 matrix A, 


23 
A=/4 5 
0 6 


Matrix A can be viewed as a three-high stack of two-element row vectors. With a semicolon to separate rows, square brackets are used to create the 
matrix. 

>> A= [2 3; 4 5; 0 6] 

A=2 3 


4 5 
(0) 6 


Each row vector needs to have the same length to create a sensible matrix. 


In addition to enclosing string arguments, a single quote performs the complex conjugate transpose operation. In this way, row vectors become 
column vectors and vice versa. For example, a column vector c is easily created by transposing row vector r. 
>> ce=r' 


Since vector r is real, the complex-conjugate transpose is just the transpose. Had r been complex, the simple transpose could have been 
accomplished by either r. 'or (conj (r))'. 


More formally, square brackets are referred to as a concatenation operator. A concatenation combines or connects smaller pieces into a larger whole. 
Concatenations can involve simple numbers, such as the six-element concatenation used to create the 3 x 2 matrix A. It is also possible to 
concatenate larger objects, such as vectors and matrices. For example, vector c and matrix A can be concatenated to form a 3 x 3 matrix B. 

>> B = [c A] 

B=1 2 

0 4 5 

(0) (0) 6 

Errors will occur if the component dimensions do not sensibly match; a 2 x 2 matrix would not be concatenated with a 3 x 3 matrix, for example. 


Elements of a matrix are indexed much like vectors, except two indices are typically used to specify row and column.!t] Element (1, 2) of matrix B, 
for example, is 2. 


>> B(1, 2) 
ans = 2 


Indices can likewise be vectors. For example, vector indices allow us to extract the elements common to the first two rows and last two columns of 
matrix B. 


>> B(1:2,2:3) 
ans = 2 3 
4 5 


One indexing technique is particularly useful and deserves special attention. A colon can be used to specify all elements along a specified dimension. 
For example, B(2, : ) selects all column elements along the second row of B. 


>> B(2,:) 
ans = 0 45 


Now that we understand basic vector and matrix creation, we turn our attention to using these tools on real problems. Consider solving a set of three 
linear simultaneous equations in three unknowns. 
x) = 2x2 + 3x3 =| 


—/3x, +X — V5x3 =F 
3x1 —V 7m +43 =e 


This system of equations is represented in matrix form according to Ax = y, where 


l —2 3 x 1 
A=|-V3 l -/5|, x= |x]. and y= (/2z 
3 ry | | Xs e 


Although Cramer's rule can be used to solve Ax = y, it is more convenient to solve by multiplying both sides by the matrix inverse of A. That is, x = 
A7'Ax = Av'y. Solving for x by hand or by calculator would be tedious at best, so MATLAB is used. We first create A and y. 


>> A ft -2 3;-sqrt(3) 1 -sqrt(5);3 -sqrt(7) 1]; 
>> y 1;pi;exp(1)]; 


The vector solution is found by using MATLAB's inv function. 


>> xX = inv(A)*y 
xX = -1.9999 
-3.8998 

-1.5999 


It is also possible to use MATLAB's left divide operator x = A\y to find the same solution. The left divide is generally more computationally efficient 
than matrix inverses. As with matrix multiplication, left division requires that the two arguments be conformable. 


Of course, Cramer's rule can be used to compute individual solutions, such as x;, by using vector indexing, concatenation, and MATLAB's det 
command to compute determinants. 


>> x1 = det([y,A(:,2:3)])/det(A) 
x1 = -1.9999 


Another nice application of matrices is the simultaneous creation of a family of curves. Consider h(t) = e~% sin(21110t + 11/6) over 0 < t < 0.2. 
Figure MB.3 shows h,(t) for « = 0 and « = 10. Let's investigate the family of curves hg(t) for a = [0, 1,..., 10]. 


An inefficient way to solve this problem is create hg(t) for each « of interest. This requires 11 individual cases. Instead, a matrix approach allows all 
11 curves to be computed simultaneously. First, a vector is created that contains the desired values of a. 
>> alpha = (0:10); 


By using a sampling interval of one millisecond, At = 0.001, a time vector is also created. 
>> t = (0:0.001:0.2)'; 


The result is a length-201 column vector. By replicating the time vector for each of the 11 curves required, a time matrix T is created. This replication 
can be accomplished by using an outer product between t and a 1 x 11 vector of ones._[T] 
>> T = t*ones(1,11); 


The result is a 201 x 11 matrix that has identical columns. Right multiplying T by a diagonal matrix created from «, columns of T can be individually 
scaled and the final result is computed. 


>> H = exp(-T*diag(alpha) ).*sin(2*pi*10*T+pi/6); 


Here, H is a 201 x 11 matrix, where each column corresponds to a different value of «. That is, H = [ho, hy,..., hyo], where hg are column vectors. 
As shown in Fig. MB.4, the 11 desired curves are simultaneously displayed by using MATLAB's plot command, which allows matrix arguments. 


>> plot(t,H); xlabel('t'); ylabel('h(t)'); 


h(t) 


l 
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Figure MB.4: h,(t) for « = [0,1,..., 10]. 


This example illustrates an important technique called vectorization, which increases execution efficiency for interpretive languages such as 


MATLAB.[#1 Algorithm vectorization uses matrix and vector operations to avoid manual repetition and loop structures. It takes practice and effort to 
become proficient at vectorization, but the worthwhile result is efficient, compact code. 


MB.7 Partial Fraction Expansions 


There are a wide variety of techniques and shortcuts to compute the partial fraction expansion of rational function F(x) = B(x)/A(x), but few are more 
simple than the MATLAB residue command. The basic form of this command is 


>> [R,P,K] = residue(B,A) 


The two input vectors B and A specify the polynomial coefficients of the numerator and denominator, respectively. These vectors are ordered in 
descending powers of the independent variable. Three vectors are output. The vector R contains the coefficients of each partial fraction, and vector P 
contains the corresponding roots of each partial fraction. For a root repeated r times, the r partial fractions are ordered in ascending powers. When 
the rational function is not proper, the vector K contains the direct terms, which are ordered in descending powers of the independent variable. 


To demonstrate the power of the residue command, consider finding the partial fraction expansion of 
xvy47 xi+x 


(x + /2)(x — /2)° ~ x4 — 8x3 + J32x —4 


By hand, the partial fraction expansion of F(x) is difficult to compute. MATLAB, however, makes short work of the expansion. 
>> [R,P,K] = residue( [1 0 0 © © pi], [1 -sgqrt(8) 9 sqrt(32) -4]) 
R 1112 


F(x) = 


= 7.8888 5.9713 3.1107 0. 
P = 1.4142 1.4142 1.4142 -1.4142 
K = 1.0000 2.8284 


Written in standard form, the partial fraction expansion of F(x) is 


F(x) mx + 2.8284 + eee +. 5.9713 ¥ 3.1107 4, OLLI2 
—— x-V¥2) (x-V2?) (x -V2)—_ x+V2 


The signal processing toolbox function residuez is similar to the residue command and offers more convenient expansion of certain rational 
functions, such as those commonly encountered in the study of discrete-time systems. Additional information about the residue and residuez 
commands are available from MATLAB's help facilities. 

[tlAdvanced structures such as MATLAB inline objects are an exception. 


[t]while grossly inefficient, element-by-element multiplication can be accomplished by extracting the main diagonal from the outer product of two N- 
length vectors. 


[t]Matrix elements can also be accessed by means of a single index, which enumerates along columns. Formally, the element from row m and 
column n of an M x N matrix may be obtained with a single index (n — 1)M + m. For example, element (1, 2) of matrix B is accessed by using the 
index (2 — 1)3 + 1 = 4. That is, B (4) yields 2. 


[tlThe repmat command provides a more flexible method to replicate or tile objects. Equivalently, T = repmat(t,1,11). 


[tl The benefits of vectorization are less pronounced in recent versions of MATLAB. 


PROBLEMS 


b.1 Given a complex number w = x + jy, the complex conjugate of w is defined in rectangular coordinates as w* = x — jy. Use this fact to 
derive complex conjugation in polar form. 


b.2 Express the following numbers in polar form: 
a. 1+j 
b. -4 +3 
c. (1 + f)(—4 + js) 
de 4s peu 
e. el +1 
f. (1 + f)/(04 + j3) 
b.3 Express the following numbers in Cartesian form: 
a, 3e/T/4 
b. tle 
c. (1 + f)(—4 + j) 
d. e/™/4 + 2e/T4 
e. el +1 
f. 1/2! 
b.4 For complex constant w, prove: 
a. Re(w) = (w+ w*)/2 


b. Im(w) = (w — w*)/2j 


b.5 Given w = x — jy, determine: 
a. Re(e”) 
b. Im(e”) 

b.6 For arbitrary complex constants w; and wa, prove or disprove the following: 
a. Re(jw1) = —Im(w1) 


b. Im(jw1) = Re(w7) 
c. Re(w1) + Re(w2) = Re(wy + w2) 
d. Im(w4) + Im(w2) = Im(w, + wo) 
e. Re(w1)Re(w2) = Re(w1, w2) 
f.. Im(w 4 )/Im(w2) = Im(w4/w2) 

b.7 Given wy = 3 + j4 and wo = 2e/T™4. 
a. Express w, in standard polar form. 


b. Express wp in standard rectangular form. 


c. Determine |w4|2 and |wo|?. 

d. Express w1 + wo in standard rectangular form. 
e. Express w4 — w2 in standard polar form. 

f. Express w1w2 in standard rectangular form. 


g. Express w4/w2 in standard polar form. 


b.8 Repeat Prob. B.7 using w = (3+ j4)* andw = 2.5 je /40T. 


b.9 


b.10 


b.11 


b.12 


b.13 


b.14 


b.15 


b.16 


b.17 


b.18 
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Repeat Prob. B.7 using w, =/ + e™4 and Wp = COs (j). 
Use Euler's identity to solve or prove the following: 
a. Find real, positive constants c and ® for all real t such that 2.5 cos (3t) — 1.5 sin (3t + 11/3) = c cos(3t + ¢) 
b. Prove that cos (8 + d) = cos (8) cos (dp) = sin (8) sin (). 
c. Given real constants a, b, and «, complex constant w, and the fact that 
¥ 1 
e*dx= —(e” — et) 
= w 


evaluate the integral 


b 
/ e”™ sin (ax) dx 
a 


In addition to the traditional sine and cosine functions, there are the hyperbolic sine and cosine functions, which are defined by sinh (w) 
= (e” — e “2 and cosh (w) = (e” + e “/2. In general, the argument is a complex constant w = x + jy. 


a. Show that cosh (w) = cosh (x) cos (y) + / sinh (x) sin (y). 


b. Determine a similar expression for sinh (w) in rectangular form that only uses functions of real arguments, such as sin (x), 
cosh (y), and so on. 


Using the complex plane: 
a. Evaluate and locate the distinct solutions to (w)4 =-1. 
b. Evaluate and locate the distinct solutions to (w — (1 + j2))° = (32/./2) (1 + j). 
c. Sketch the solution to |w — 2] = 3. 
d. Graph w(t) = (1 + t)e for (—10 < t < 10). 


The distinct solutions to (w — w1)" = wo lie on a circle in the complex plane, as shown in Fig. PB.13. One solution is located on the 
real axis at \/3 + 1 = 2.732, and one solution is located on the imaginary axis at /3 — 10.732. Determine W1, Wo, and n. 


Figure PB.13: Distinct solutions to (w — w 1)” = wo. 


Find the distinct solutions to (j — wt = 2 + j2. Use MATLAB to graph the solution set in the complex plane. 

If j= /—1, what is \/j? 

Find all the values of In(—e), expressing your answer in Cartesian form. 

Determine all values of log;9(—1), expressing your answer in Cartesian form. Notice that the logarithm has base 10, not e. 


Express the following in standard rectangular coordinates: 


a. In(1/(1+/)) 


b. cos(1 + j) 
c. (1 — jy 


b.19 By constraining w to be purely imaginary, show that the equation cos (w) = 2 can be represented as a standard quadratic equation. 
Solve this equation for w. 


b.20 Determine an expression for an exponentially decaying sinusoid that oscillates three times per second and whose amplitude envelope 
decreases by 50% every 2 seconds. Use MATLAB to plot the signal over —2 < t < 2. 


b.21 By hand, sketch the following against independent variable tf: 
a. x4(t) = Re(2e1 */2T)t) 
b. x9(t) = Im(3 — e( ~/2™e) 
c. x3(t) = 3 — Im(e(t — 2M) 

b.22 | Use MATLAB to produce the plots requested in Prob. B.21. 


b.23. Use MATLAB to plot x(t) = cos (ft) sin (20t) over a suitable range of t. 


b.24 Use MATLAB to plot x(t) = 510/84 cos (2tTrkt) over a suitable range of t. The MATLAB command sum may prove useful. 


b.25 When a bell is struck with a mallet, it produces a ringing sound. Write an equation that approximates the sound produced by a small, 
light bell. Carefully identify your assumptions. How does your equation change if the bell is large and heavy? You can assess the 
quality of your models by using the MATLAB sound command to listen to your "bell." 


b.26 Certain integrals, although expressed in relatively simple form, are quite difficult to solve. For example, J e*2 dx cannot be evaluated 


in terms of elementary functions; most calculators that perform integration cannot handle this indefinite integral. Fortunately, you are 
smarter than most calculators. 
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a. Express e-** using a Taylor series expansion. 


b. Using your series expansion for e*2 | determine J e~*2 ax. 


c. Using a suitably truncated series, evaluate the definite integral "5 e 2 ax, 
b.27 Repeat Prob. B.26 for J e-*? dx. 
b.28 Repeat Prob. B.26 for J cos x2 dx. 
b.29 For each function, determine a suitable series expansion. 

a. f(x) = (2 —x2)"" 

b. f(x) = (0.5)* 


b.30 You are working on a digital quadrature amplitude modulation (QAM) communication receiver. The QAM receiver requires a pair of 
quadrature signals: cos Qn and sin On. These can be simultaneously generated by following a simple procedure: (1) choose a point w 
on the unit circle, (2) multiply w by itself and store the result, (3) multiply w by the last result and store, and (4) repeat step 3. 


a. Show that this method can generate the desired pair of quadrature sinusoids. 


b. Determine a suitable value of w so that good-quality, periodic, 2Tr x 100,000 rad/s signals can be generated. How much 
time is available for the processing unit to compute each sample? 


c. Simulate this procedure by using MATLAB and report your results. 


d. Identify as many assumptions and limitations to this technique as possible. For example, can your system operate 
correctly for an indefinite period of time? 


b.31 Consider the following system of equations. 
xX) + X2+243 = 1 
3 


XxX} — X= —3 


x, + 2x2 + 3x; 


Use Cramer's rule to determine: 


a. X4 


C. X3 
Matrix determinants can be computed by using MATLAB's det command. 

b.32 A system of equations in terms of unknowns x, and x2 and arbitrary constants a, b, c, d, e, and fis given by 
ax; +bx,=c¢ 

f 


a. Represent this system of equations in matrix form. 


ax, + exo 


II 


b. Identify specific constants a, b, c, d, e, and f such that x4 = 3 and x = —2. Are the constants you selected unique? 
c. Identify nonzero constants a, b, c, d, e, and f such that no solutions x4 and x2 exist. 
d. Identify nonzero constants a, b, c, d, e, and f such that an infinite number of solutions x; and x2 exist. 
b.33 Solve the following system of equations: 
Xt +43 +4 =4 
Xt+wy+%—Xs = 2 


Xx) +o — 33 —x%, =0 


XY —- hw ew XM = —2 


b.34 Solve the following system of equations: 
Xx $42+ 53 +245 = 1 
xX, — 2x2 + 3x3 = 2 
xX, —%3 + 7x, = 3 

—2x. + 3x, —4u3 = 4 


b.35 | Compute by hand the partial fraction expansions of the following rational functions: 
a. H4(s) = (s? + 5s + 6)/(s? +2 +5+ 1), which has denominator poles at s = + j and s = —1 
b. Ho(s) = 1/H4(s) = (s° + s2 +s + 1\(s? + 5s + 6) 
c. Ho(s) = 1((s + 1)°(s? + 1) 
d. Ha(s) = (s? + 5s + 6)/(3s2 + 2s + 1) 
b.36 Using MATLAB's residue command, 
a. Verify the results of Prob. B.35a. 
b. Verify the results of Prob. B.35b. 
c. Verify the results of Prob. B.35c. 


d. Verify the results of Prob. B.35d. 


b.37 Determine the constants ao, a4, and ap of the partial fraction expansion F(s) = s/(s + 1 = agl(s + 1)3 + a4l(s + 1)? + agl(s + 1). 


b.38 Let N = [n7, ng, N5,...,92, 24] represent the seven digits of your phone number. Construct a rational function according to 


2 I 
N7S" +NgS +s +N4S 
Hy (s) = —[——c 


n3s* + nos + ay 


Use MATLAB's residue command to compute the partial fraction expansion of Hjj(s). 


b.39 When plotted in the complex plane for —Tt < w < Tr, the function f (w) = cos(w) + j0.1 sin(2w) results in a so-called Lissajous figure 
that resembles a two-bladed propeller. 


a. In MATLAB, create two row vectors fr and fi corresponding to the real and imaginary portions of f (w), respectively, 
over a suitable number N samples of w. Plot the real portion against the imaginary portion and verify the figure 
resembles a propeller. 


b. Let complex constant w = x + jy be represented in vector form 


“-[5 


Consider the 2 x 2 rotational matrix R: 
R cos? —sin@d 
~ |sin@  cos@ 
Show that Rw rotates vector w by 6 radians. 


c. Create a rotational matrix R corresponding to 10° and multiply it by the 2 x N matrix f = [f r; f i];. Plot the result 
to verify that the "propeller" has indeed rotated counterclockwise. 


d. Given the matrix R determined in part c, what is the effect of performing RRF? How about RRRf? Generalize the result. 


e. Investigate the behavior of multiplying f (Ww) by the function el? 


Chapter 1: Signals and Systems 


OVERVIEW 


In this chapter we shall discuss certain basic aspects of signals. We shall also introduce important basic concepts and qualitative 
explanations of the hows and whys of systems theory, thus building a solid foundation for understanding the quantitative analysis in the 
remainder of the book. 


SIGNALS 


A signal is a set of data or information. Examples include a telephone or a television signal, monthly sales of a corporation, or daily 
closing prices of a stock market (e.g., the Dow Jones averages). In all these examples, the signals are functions of the independent 
variable time. This is not always the case, however. When an electrical charge is distributed over a body, for instance, the signal is the 
charge density, a function of space rather than time. In this book we deal almost exclusively with signals that are functions of time. The 
discussion, however, applies equally well to other independent variables. 


SYSTEMS 


Signals may be processed further by systems, which may modify them or extract additional information from them. For example, an 
antiaircraft gun operator may want to know the future location of a hostile moving target that is being tracked by his radar. Knowing the 
radar signal, he knows the past location and velocity of the target. By properly processing the radar signal (the input), he can 
approximately estimate the future location of the target. Thus, a system is an entity that processes a set of signals (inputs) to yield 
another set of signals (outputs). A system may be made up of physical components, as in electrical, mechanical, or hydraulic systems 
(hardware realization), or it may be an algorithm that computes an output from an input signal (software realization). 


1.1 SIZE OF A SIGNAL 


The size of any entity is a number that indicates the largeness or strength of that entity. Generally speaking, the signal amplitude varies 
with time. How can a signal that exists over a certain time interval with varying amplitude be measured by one number that will indicate 
the signal size or signal strength? Such a measure must consider not only the signal amplitude, but also its duration. For instance, if we 
are to devise a single number V as a measure of the size of a human being, we must consider not only his or her width (girth), but also 
the height. If we make a simplifying assumption that the shape of a person is a cylinder of variable radius r (which varies with the 
height h) then one possible measure of the size of a person of height H is the person's volume V, given by 


H 
vaa/ r?(h) dh (1.1) 
o 


1.1-1 Signal Energy 


Arguing in this manner, we may consider the area under a signal x(t) as a possible measure of its size, because it takes account not 
only of the amplitude but also of the duration. However, this will be a defective measure because even for a large signal x(t), its 
positive and negative areas could cancel each other, indicating a signal of small size. This difficulty can be corrected by defining the 


signal size as the area under x(t), which is always positive. We call this measure the signal energy Ey, defined (for a real signal) as 


oO 
E, = / x*(t)dt (1.2a) 
This definition can be generalized to a complex valued signal x(t) as 
Od 
Bow / Ix(t)Pat (1.26) 


There are also other possible measures of signal size, such as the area under |x(t)|. The energy measure, however, is not only more 
tractable mathematically but is also more meaningful (as shown later) in the sense that it is indicative of the energy that can be 
extracted from the signal. 


1.1-2 Signal Power 


The signal energy must be finite for it to be a meaningful measure of the signal size. A necessary condition for the energy to be finite is 
that the signal amplitude — 0 as |t| — o (Fig. 1.1a). Otherwise the integral in Eq. (1.2a) will not converge. 


b> 


Figure 1.1: Examples of signals: (a) a signal with finite energy and (b) a signal with finite power. 


When the amplitude of x(t) does not — 0 as |t| — © (Fig. 1.1b), the signal energy is infinite. A more meaningful measure of the signal 
size in such a case would be the time average of the energy, if it exists. This measure is called the power of the signal. For a signal 
x(t), we define its power P, as 


1 oft. 
Pp. = lim + x(t) dt (1.3a) 


T+x {2 
We can generalize this definition for a complex signal x(t) as 


ie... 
P, = lim — x(n) dt (1.3b) 


ToT J_ry2 


Observe that the signal power P, is the time average (mean) of the signal amplitude squared, that is, the mean-squared value of x(t). 
Indeed, the square root of P, is the familiar rms (root-mean-square) value of x(t). 


Generally, the mean of an entity averaged over a large time interval approaching infinity exists if the entity either is periodic or has a 
statistical regularity. If such a condition is not satisfied, the average may not exist. For instance, a ramp signal x(t) = ¢ increases 
indefinitely as |f| — o, and neither the energy nor the power exists for this signal. However, the unit step function, which is not periodic 
nor has statistical regularity, does have a finite power. 


When x(t) is periodic, |x(t)|? is also periodic. Hence, the power of x(t) can be computed from Eq. (1.3b) by averaging |x(t)|? over one 
period. 


Comments. The signal energy as defined in Eqs. (1.2) does not indicate the actual energy (in the conventional sense) of the signal 
because the signal energy depends not only on the signal, but also on the load. It can, however, be interpreted as the energy 
dissipated in a normalized load of a 1-ohm resistor if a voltage x(t) were to be applied across the 1-ohm resistor (or if a current x(t) 
were to be passed through the 1 -ohm resistor). The measure of "energy" is, therefore indicative of the energy capability of the signal, 
not the actual energy. For this reason the concepts of conservation of energy should not be applied to this "signal energy." Parallel 
observation applies to "signal power" defined in Eqs. (1.3). These measures are but convenient indicators of the signal size, which 
prove useful in many applications. For instance, if we approximate a signal x(t) by another signal g(t), the error in the approximation is 
e(t) = x(t) — g(t). The energy (or power) of e(f) is a convenient indicator of the goodness of the approximation. It provides us with a 
quantitative measure of determining the closeness of the approximation. In communication systems, during transmission over a channel, 
message signals are corrupted by unwanted signals (noise). The quality of the received signal is judged by the relative sizes of the 
desired signal and the unwanted signal (noise). In this case the ratio of the message signal and noise signal powers (signal to noise 
power ratio) is a good indication of the received signal quality. 


Units of Energy and Power. Equations (1.2) are not correct dimensionally. This is because here we are using the term energy not in 
its conventional sense, but to indicate the signal size. The same observation applies to Eqs. (1.3) for power. The units of energy and 
power, as defined here, depend on the nature of the signal x(t). If x(t) is a voltage signal, its energy E, has units of volts squared- 
seconds (V2 s), and its power Py, has units of volts squared. If x(t) is a current signal, these units will be amperes squared-seconds (A2 
Ss) and amperes squared, respectively. 


EXAMPLE 1.1 
Determine the suitable measures of the signals in Fig. 1.2. 
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Figure 1.2 


In Fig. 1.2a, the signal amplitude — 0 as |t| — oo. Therefore the suitable measure for this signal is its energy E, given by 


x 0 _ 
z= | rod = [ (2)? dt + 4e'dt=4+4=8 


1 6 
In Fig. 1.2b, the signal amplitude does not — 0 as |¢| — o. However, it is periodic, and therefore its power exists. We can use Eq. 
(1.3a) to determine its power. We can simplify the procedure for periodic signals by observing that a periodic signal repeats regularly 


each period (2 seconds in this case). Therefore, averaging x(t) over an infinitely large interval is identical to averaging this quantity 
over one period (2 seconds in this case). Thus 


1 1 
P =1/ rad =t | rdt=4 
1 1 


Recall that the signal power is the square of its rms value. Therefore, the rms value of this signal is 1/./3. 


EXAMPLE 1.2 
Determine the power and the rms value of 


a. x(t) = C cos (Wot + 8) 
b. x(t) = C1 cos (w4t+ 64) + Co cos (Wat + 89) Wy # Wo 
c. x(t) = De/ot 


a. This is a periodic signal with period Tp = 2Tt/Wg. The suitable measure of this signal is its power. Because it is a periodic 
signal, we may compute its power by averaging its energy over one period Tg = 2Tt/Wg. However, for the sake of 
ea we shall solve this problem 8 averaging over an infinitely large time interval using Eq. (1.3a). 


o 
2, = jim _ +f C? cos* (aot +0) dt = jim or [ [1 + cos (2at + 20)) dt 
: T/2 


cq? tr Gtr 
- —— ratte “ye (9, 9 
= jim T J rn dt + jim LOT Inn COS (Zapf + 20) dt 


The first term on the right-hand side is equal to C2/2. The second term, however, is zero because the integral appearing 
in this term represents the area under a sinusoid over a very large time interval T with T — oo. This area is at most equal 
to the area of half the cycle because of cancellations of the positive and negative areas of a sinusoid. The second term is 


this area multiplied by C2/2T with T — o. Clearly this term is zero, and 
Cc? 
P, = = (14a) 
This shows that a sinusoid of amplitude C has a power C72 regardless of the value of its frequency Wa (Wa + 0) and 
phase 0. The rms value is C/./2. If the signal frequency is zero (dc or a constant signal of amplitude C), the reader can 
show that the power is C2. 


b. In Chapter 6, we shall show that a sum of two sinusoids may or may not be periodic, depending on whether the ratio 
W4/W2 is a rational number. Therefore, the period of this signal is not known. Hence, its power will be determined by 
averaging its energy over T seconds with T — oo. Thus, 


I TR > 
P= jim T [C, cos (ef + O,) + Cr cos (at + 42)]° dt 
> tr 
oe f Rog 
= lim — fi Cr cos” (antl + A) dt + {in T Cy cos* (af + :) dt 
-Tj2 = -1/2 


— (20,Cy fr 
+ lm —— COS (@)f + 0) COS (@ sf + Os) dl 
T +00 T Th 


The first and second integrals on the right-hand side are the powers of the two sinusoids, which are 074/20 and C25/2 as 
found in part (a). The third term, the product of two sinusoids, can be expressed as a sum of two sinusoids cos [(w4 + 


WW)! + (84 + O2)] and cos [(w4 — Ww)! + (84 — 2), respectively. Now, arguing as in part (a), we see that the third term 
is zero. Hence, we havelt] 


4 4) 
C; “ Bg 


Ps 2 


= 


and the rms value is V (C;’ + C,*)/2. 


We can readily extend this result to a sum of any number of sinusoids with distinct frequencies. Thus, if 
~ 


x(t) = }> Cy COS (wt + 9) 


n=l 


P, (1.4b) 


assuming that none of the two sinusoids have identical frequencies and w, + 0, then 


Reet Co (1.4) 


If x(t) also has a dc term, as 
oo 

x(t) =Co+t+ a Cy COS (@pt + Oy) 
n=1 

then 


oo 


Py = G + >> be (1.4d) 


| 


c. In this case the signal is complex, and we use Eq. (1.3b) to compute the power. 


be yes 
P, = lim z/ De!" dt 
x= im = oa | 


Recall that |e/“o!] = 1 so that |De/ot|2 = |D|2, and 


P, = |D/? (1.4e) 


The rms value is |D]. 


Comment. In part (b) of Example 1.2, we have shown that the power of the sum of two sinusoids is equal to the sum of the powers of 
the sinusoids. It may appear that the power of x(t) + x2(f) is Py + Pyz. Unfortunately, this conclusion is not true in general. It is true 


only under a certain condition (orthogonality), discussed later (Section 6.5-3). 


EXERCISE E1.1 

Show that the energies of the signals in Fig. 1.3a, 1.3b, 1.3c, and 1.3d are 4, 1, 4/3, and 4/3, respectively. Observe that doubling a 
signal quadruples the energy, and time-shifting a signal has no effect on the energy. Show also that the power of the signal in Fig. 1.3e 
is 0.4323. What is the rms value of signal in Fig. 1.3e? 
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EXERCISE E1.2 
Redo Example 1.2a to find the power of a sinusoid C cos (Wot + 8) by averaging the signal energy over one period To = 211/wWo 


(rather than averaging over the infinitely large interval). Show also that the power of a dc signal x(t) = Cg is C*o. and its rms value is 
Co. 


EXERCISE E1.3 
Show that if w4 = Wo, the power of x(t) = C1 cos (w4t+ 04) + Co cos (Wot + Oo) is [C24 + C29 + 2C4Cp cos (04 — 84)]/2, which is 
not equal to (C2, + C25)/2. 


[Tl This is true only if W 4 # Wo. If wW4 = We, the integrand of the third term contains a constant cos (8; — 92), and the third term — 
2C4C2 cos (0; — 89) as T— ov. 


1.2 SOME USEFUL SIGNAL OPERATIONS 


We discuss here three useful signal operations: shifting, scaling, and inversion. Since the independent variable in our signal description 
is time, these operations are discussed as time shifting, time scaling, and time reversal (inversion). However, this discussion is valid for 
functions having independent variables other than time (e.g., frequency or distance). 


1.2-1 Time Shifting 


Consider a signal x(t) (Fig. 1.4a) and the same signal delayed by T seconds (Fig. 1.4b), which we shall denote by (t). Whatever 
happens in x(t) (Fig. 1.4a) at some instant t also happens in ¢(t) (Fig. 1.4b) T seconds later at the instant t + T. Therefore 


d(t+T) =x0) (1.5) 


and 


o(t)=xt—T) (1.6) 


{a) 
A(t) = x(t — T) 


x(t + T) 


: : {c) 
Figure 1.4: Time-shifting a signal. 


Therefore, to time-shift a signal by 7, we replace t with t — T. Thus x(t — T) represents x(t) time-shifted by T seconds. If T is positive, 
the shift is to the right (delay), as in Fig. 1.4b. If T is negative, the shift is to the left (advance), as in Fig. 1.4c. Clearly, x(t — 2) is x(t) 
delayed (right-shifted) by 2 seconds, and x(t + 2) is x(t) advanced (left-shifted) by 2 seconds. 


EXAMPLE 1.3 


An exponential function x(t) = e~2t shown in Fig. 1.5a is delayed by 1 second. Sketch and mathematically describe the delayed 
function. Repeat the problem with x(t) advanced by 1 second. 


mir 


fe) 


Figure 1.5: (a) Signal x(t). (b) Signal x(t) delayed by 1 second. (c) Signal x(t) advanced by 1 second. 


The function x(t) can be described mathematically as 


e* r>0 
(t) = a 1.7 
x(t) 0 tet (1.7) 


Let xq(t) represent the function x(t) delayed (right-shifted) by 1 second as illustrated in Fig. 1.5b. This function is x(t — 1); its 
mathematical description can be obtained from x(t) by replacing f with t — 1 in Eq. (1.7). Thus 


(1) (t-1) jie ae ee (1.8) 

xy(O=xt-l= 5 

av? 0 t-—1<0 or ¢<1 

Let x,(t) represent the function x(t) advanced (left-shifted) by 1 second as depicted in Fig. 1.5c. This function is x(t + 1); its 
mathematical description can be obtained from x(t) by replacing t with f+ 1 in Eq. (1.7). Thus 


(1) =x(t+1) em REL ED Oe Beet (1.9) 
XU) = XU - : 
0 t+1<0 or t<-1 


that this delayed signal xq(t) can be described mathematically as xg(t) = 2(t — 2) for 2 < t < 3, and equal to 0 otherwise. Now repeat 
the procedure with the signal advanced (left-shifted) by 1 second. Show that this advanced signal x,(t) can be described as x,(t) = 2(t 
+ 1) for — 1 < t < 0, and equal to 0 otherwise. 

1.2-2 Time Scaling 

The compression or expansion of a signal in time is known as time scaling. Consider the signal x(t) of Fig. 1.6a. The signal q(t) in Fig. 


1.6b is x(t) compressed in time by a factor of 2. Therefore, whatever happens in x(t) at some instant t also happens to $(f) at the 
instant t/2, so that 


p (5) = x(t) (1.10) 


and 


b(t) = x(2t) (1.11) 


x(t) 


(b) 


{c) 


27, 0 aT. i 
Figure 1.6: Time scaling a signal. 


Observe that because x(t) = 0 at t= 7, and To, we must have (ft) = 0 at t = 74/2 and T>/2, as shown in Fig. 1.6b. If x(t) were 
recorded on a tape and played back at twice the normal recording speed, we would obtain x(2?). In general, if x(t) is compressed in 
time by a factor a (a > 1), the resulting signal (t) is given by 


b(t) = x{at) (1.12) 
Using a similar argument, we can show that x(t) expanded (slowed down) in time by a factor a (a > 1) is given by 
t 
p(t) =1(<) (1.13) 


Figure 1.6c shows x(t/2), which is x(t) expanded in time by a factor of 2. Observe that in a time-scaling operation, the origin f = 0 is the 
anchor point, which remains unchanged under the scaling operation because at tf = 0, x(t) = x(at) = x(0). 


In summary, to time-scale a signal by a factor a, we replace tf with at. If a > 1, the scaling results in compression, and if a < 1, the 
scaling results in expansion. 


EXAMPLE 1.4 


Figure 1.7a shows a signal x(t). Sketch and describe mathematically this signal time-compressed by factor 3. Repeat the problem for 
the same signal time-expanded by factor 2. 


(c) 
Figure 1.7: (a) Signal x(t),(b) signal x(3t), and (c) signal x(t/2). 


The signal x(t) can be described as 


2 -15<r<0 
xth=<2e'? O<t<3 (1.14) 
0 otherwise 


Figure 1.7b shows x,(t), which is x(t) time-compressed by factor 3; consequently, it can be described mathematically as x(32), which is 
obtained by replacing t with 3¢ in the right-hand side of Eq. (1.14). Thus 


2 15<31<0 or -O05<1<0 
x(t) = x(3t) = ( 26°9"? 0<3 <3 or O<t<! (1,15a) 
0 otherwise 


Observe that the instants f = —1.5 and 3 in x(t) correspond to the instants tf = —0.5, and 1 in the compressed signal x(3f). 


Figure 1.7c shows x,(t), which is x(t) time-expanded by factor 2; consequently, it can be described mathematically as x(t/2), which is 
obtained by replacing ¢ with ¢/2 in x(t). Thus 


t 
2 -l5<>5<0 or =-3<1<0 
t 2 
a eo t 
x =x(5) = 2ets 0<5<3 ie 0<1<6 (1.15b) 
0 otherwise 


Observe that the instants t= —1.5 and 3 in x(t) correspond to the instants tf = —3 and 6 in the expanded signal x(¢t/2). 


EXERCISE E1.5, . : 
Show that the time compression by a factor n (n > 1) of a sinusoid results in a sinusoid of the same amplitude and phase, but with the 
frequency increased n-fold. Similarly, the time expansion by a factor n (n > 1) of a sinusoid results in a sinusoid of the same amplitude 
and phase, but with the frequency reduced by a factor n. Verify your conclusion by sketching a sinusoid sin 2¢ and the same sinusoid 
compressed by a factor 3 and expanded by a factor 2. 


1.2-3 Time Reversal 


Consider the signal x(t) in Fig. 1.8a. We can view x(t) as a rigid wire frame hinged at the vertical axis. To time-reverse x(t), we rotate 
this frame 180° about the vertical axis. This time reversal [the reflection of x(t) about the vertical axis] gives us the signal $(t) (Fig. 
1.8b). Observe that whatever happens in Fig. 1.8a at some instant t also happens in Fig. 1.8b at the instant —f, and vice versa. 
Therefore 


d(t) =x(-1) (1.16) 


(a) 


> bi) =x(-) 


(b) 
Figure 1.8: Time reversal of a signal. 


Thus, to time-reverse a signal we replace ¢ with —t, and the time reversal of signal x(t) results in a signal x(—f). We must remember 
that the reversal is performed about the vertical axis, which acts as an anchor or a hinge. Recall also that the reversal of x(t) about the 
horizontal axis results in — x(t). 


EXAMPLE 1.5 
For the signal x(f) illustrated in Fig. 1.9a, sketch x(—f), which is time-reversed x(t). 


(b) 
Figure 1.9: Example of time reversal. 
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The instants —1 and —5 in x(t) are mapped into instants 1 and 5 in x(—t). Because x(t) = et/2, we have x(-f) = e'/2 The signal x(—f) 


is depicted in Fig. 1.95. We can describe x(t) and x(—t) as 


e'/? -1>t>-5 
x(t) = : 
0 otherwise 
and its time reversed version x(—t) is obtained by replacing ft with —f in x(t) as 
et -l>-t>-5 of 1<t<5 
x(-1) = ‘ 
0 otherwise 


1.2-4 Combined Operations 


Certain complex operations require simultaneous use of more than one of the operations just described. The most general operation 
involving all the three operations is x(at — b), which is realized in two possible sequences of operation: 


1. Time-shift x(t) by b to obtain x(t — b). Now time-scale the shifted signal x(t — b) by a (i.e., replace ¢ with af) to obtain x(at 
— b). 


2. Time-scale x(t) by a to obtain x(at). Now time-shift x(at) by b/a (i.e., replace t with t — (b/a)) to obtain x[a(t — b/a)] = x(at 
— b). In either case, if a is negative, time scaling involves time reversal. 


For example, the signal x(2f — 6) can be obtained in two ways. We can delay x(t) by 6 to obtain x(t — 6), and then time-compress this 
signal by factor 2 (replace t with 2f) to obtain x(2t — 6). Alternately, we can first time-compress x(t) by factor 2 to obtain x(2t), then 
delay this signal by 3 (replace t with f — 3) to obtain x(2t — 6). 


1.3 CLASSIFICATION OF SIGNALS 


There are several classes of signals. Here we shall consider only the following classes, which are suitable for the scope of this book: 
1. Continuous-time and discrete-time signals 
. Analog and digital signals 


2 
3. Periodic and aperiodic signals 
4. Energy and power signals 
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. Deterministic and probabilistic signals 


1.3-1 Continuous-Time and Discrete-Time Signals 


A signal that is specified for a continuum of values of time t (Fig. 1.10a) is a continuous-time signal, and a signal that is specified only at 
discrete values of t (Fig. 1.10b) is a discrete-time signal. Telephone and video camera outputs are continuous-time signals, whereas the 
quarterly gross national product (GNP), monthly sales of a corporation, and stock market daily averages are discrete-time signals. 


fa 


Quarterly GNP : The return of recession 
fe peroeet change; seasonally adjusted annual raics 
Source : Commerce Departracat, news reports 


Two comocwtive droge 
Retern of recession 


Figure 1.10: (a) Continuous-time and (b) discrete-time signals. 


1.3-2 Analog and Digital Signals 


The concept of continuous time is often confused with that of analog. The two are not the same. The same is true of the concepts of 
discrete time and digital. A signal whose amplitude can take on any value in a continuous range is an analog signal. This means that an 
analog signal amplitude can take on an infinite number of values. A digital signal, on the other hand, is one whose amplitude can take 
on only a finite number of values. Signals associated with a digital computer are digital because they take on only two values (binary 
signals). A digital signal whose amplitudes can take on M values is an M-ary signal of which binary (M = 2) is a special case. The terms 
continuous time and discrete time qualify the nature of a signal along the time (horizontal) axis. The terms analog and digital, on the 
other hand, qualify the nature of the signal amplitude (vertical axis). Figure 1.11 shows examples of signals of various types. It is clear 
that analog is not necessarily continuous-time and digital need not be discrete-time. Figure 1.11c¢ shows an example of an analog 
discrete-time signal. An analog signal can be converted into a digital signal [analog-to-digital (A/D) conversion] through quantization 
(rounding off), as explained in Section 8.3. 
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Figure 1.11: Examples of signals: (a) analog, continuous time, (b) digital, continuous time, (c) analog, discrete time, and (d) digital, 
discrete time. 
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1.3-3 Periodic and Aperiodic Signals 
A signal x(t) is said to be periodic if for some positive constant To 


x(t) =x(t+T) for all 1 (1.17) 


The smallest value of To that satisfies the periodicity condition of Eq. (1.17) is the fundamental period of x(t). The signals in Figs. 1.2b 


and 1.3e are periodic signals with periods 2 and 1, respectively. A signal is aperiodic if it is not periodic. Signals in Figs. 1.2a, 1.3a, 
1.3b, 1.3c, and 1.3d are all aperiodic. 


By definition, a periodic signal x(t) remains unchanged when time-shifted by one period. For this reason a periodic signal must start at ¢ 
= — oo: if it started at some finite instant, say ¢t = 0, the time-shifted signal x(t + Tg) would start at f= —7To and x(t + Tg) would not be 
the same as x(t). Therefore a periodic signal, by definition, must start at t= — 0 and continue forever, as illustrated in Fig. 1.12. 


= — i, 


Figure 1.12: A periodic signal of period To. 


Another important property of a periodic signal x(t) is that x(t) can be generated by periodic extension of any segment of x(t) of duration 
To (the period). As a result we can generate x(t) from any segment of x(t) having a duration of one period by placing this segment and 
the reproduction thereof end to end ad infinitum on either side. Figure 1.13 shows a periodic signal x(t) of period Tg = 6. The shaded 
portion of Fig. 1.13a shows a segment of x(t) starting at f= —1 and having a duration of one period (6 seconds). This segment, when 
repeated forever in either direction, results in the periodic signal x(t). Figure 1.13b shows another shaded segment of x(t) of duration To 
starting at t = 0. Again we see that this segment, when repeated forever on either side, results in x(t). The reader can verify that this 
construction is possible with any segment of x(t) starting at any instant as long as the segment duration is one period. 


(b) 


Figure 1.13: Generation of a periodic signal by periodic extension of its segment of one-period duration. 


An additional useful property of a periodic signal x(t) of period To is that the area under x(t) over any interval of duration To is the 
same; that is, for any real numbers a and b 


a+To b+ Te 
| x(t)dt ={ x(t)dt (1.18) 
a b 


This result follows from the fact that a periodic signal takes the same values at the intervals of Tg. Hence, the values over any segment 
of duration Tg are repeated in any other interval of the same duration. For convenience, the area under x(t) over any interval of duration 
To will be denoted by 


/ x(t)dt 
Ta 


It is helpful to label signals that start at f= — oo and continue forever as everlasting signals. Thus, an everlasting signal exists over the 
entire interval — oo < t < oo. The signals in Figs. 1.1b and 1.2b are examples of everlasting signals. Clearly, a periodic signal, by 
definition, is an everlasting signal. 


A signal that does not start before t = 0 is a causal signal. In other words, x(t) is a causal signal if 
x(t)=0 P08 (1.19) 


Signals in Fig. 1.3a-1.3c are causal signals. A signal that starts before t = 0 is a noncausal signal. All the signals in Fig. 1.1 and 1.2 are 
noncausal. Observe that an everlasting signal is always noncausal but a noncausal signal is not necessarily everlasting. The everlasting 
signal in Fig. 1.2b is noncausal; however, the noncausal signal in Fig. 1.2a is not everlasting. A signal that is zero for all t => 0 is called 

an anticausal signal. 


Comment. A true everlasting signal cannot be generated in practice for obvious reasons. Why should we bother to postulate such a 
signal? In later chapters we shall see that certain signals (e.g., an impulse and an everlasting sinusoid) that cannot be generated in 
practice do serve a very useful purpose in the study of signals and systems. 


1.3-4 Energy and Power Signals 


A signal with finite energy is an energy signal, and a signal with finite and nonzero power is a power signal. Signals in Fig. 1.2a and 
1.2b are examples of energy and power signals, respectively. Observe that power is the time average of energy. Since the averaging is 
over an infinitely large interval, a signal with finite energy has zero power, and a signal with finite power has infinite energy. Therefore, a 
signal cannot both be an energy signal and a power signal. If it is one, it cannot be the other. On the other hand, there are signals that 
are neither energy nor power signals. The ramp signal is one such case. 


Comments. All practical signals have finite energies and are therefore energy signals. A power signal must necessarily have infinite 
duration; otherwise its power, which is its energy averaged over an infinitely large interval, will not approach a (nonzero) limit. Clearly, it 
is impossible to generate a true power signal in practice because such a signal has infinite duration and infinite energy. 


Also, because of periodic repetition, periodic signals for which the area under |x(t)|? over one period is finite are power signals; 
however, not all power signals are periodic. 

EXERCISE E1.6 a 
Show that an everlasting exponential e~@ is neither an energy nor a power signal for any real value of a. However, if a is imaginary, it 
is a power signal with power P, = 1 regardless of the value of a. 


1.3-5 Deterministic and Random Signals 


A signal whose physical description is known completely, either in a mathematical form or a graphical form, is a deterministic signal. A 


signal whose values cannot be predicted precisely but are known only in terms of probabilistic description, such as mean value or 
mean-squared value, is a random signal. In this book we shall exclusively deal with deterministic signals. Random signals are beyond 
the scope of this study. 


1.4 SOME USEFUL SIGNAL MODELS 


In the area of signals and systems, the step, the impulse, and the exponential functions play very important role. Not only do they serve 
as a basis for representing other signals, but their use can simplify many aspects of the signals and systems. 


1.4-1 Unit Step Function u(t) 


In much of our discussion, the signals begin at t = 0 (causal signals). Such signals can be conveniently described in terms of unit step 
function u(t) shown in Fig. 1.14a. This function is defined by 
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Figure 1.14: (a) Unit step function u(t). (b) Exponential e y(t). 


If we want a signal to start at f = 0 (so that it has a value of zero for tf < 0), we need only multiply the signal by u(t). For instance, the 
signal eat represents an everlasting exponential that starts at f = — oo. The causal form of this exponential (Fig. 1.14b) can be 
described as e # u(t). 


The unit step function also proves very useful in specifying a function with different mathematical descriptions over different intervals. 
Examples of such functions appear in Fig. 1.7. These functions have different mathematical descriptions over different segments of time 
as seen from Eqs. (1.14), (1.15a), and (1.15b). Such a description often proves clumsy and inconvenient in mathematical treatment. We 
can use the unit step function to describe such functions by a single expression that is valid for all t 


Consider, for example, the rectangular pulse depicted in Fig. 1.15a. We can express such a pulse in terms of familiar step functions by 
observing that the pulse x(t) can be expressed as the sum of the two delayed unit step functions as shown in Fig. 1.15b. The unit step 
function u(t) delayed by T seconds is u(t — T). From Fig. 1.15b, it is clear that 

x(t) = u(t —2) — u(t — 4) 


(a) ib) 


Figure 1.15: Representation of a rectangular pulse by step functions. 


EXAMPLE 1.6 
Describe the signal in Fig. 1.16a. 


(c) 
Figure 1.16: Representation of a signal defined interval by interval. 


The signal illustrated in Fig. 1.16a can be conveniently handled by breaking it up into the two components x,(f) and x(t), depicted in 
Fig. 1.16b and 1.16c, respectively. Here, x(t) can be obtained by multiplying the ramp ft by the gate pulse u(t) — u(t — 2), as shown in 
Fig. 1.16b. Therefore 

xi(t) = (fu(t) — u(t — 2)] 

The signal x(t) can be obtained by multiplying another ramp by the gate pulse illustrated in Fig. 1.16c. This ramp has a slope —2; 
hence it can be described by —2t + c. Now, because the ramp has a zero value at f = 3, the constant c = 6, and the ramp can be 
described by —2(t — 3). Also, the gate pulse in Fig. 1.16c is u(t — 2) — u(t — 3). Therefore 

xo(t) = —2(¢ — 3)[u(t — 2) — u(t — 3)] 

and 

x(t) =x (1) + x2(t) 


=![u(t) — u(t — 2)] — 2(¢ — 3) [u(t — 2) — u(t — 3)] 
=tu(t) — 3(t —2)u(t —2) +2(¢ — 3)u(t — 3) 


EXAMPLE 1.7 


Describe the signal in Fig. 1.7a by a single expression valid for all ¢. 


Over the interval from —1.5 to 0, the signal can be described by a constant 2, and over the interval from 0 to 3, it can be described by 
2e "2. Therefore 


x(t) = 2[u(t + 1.5) — u(t)] + 2e~?[u(t) — u(t — 3)) 
eS pa 
xiff) x2f) 


= 2u(t + 1.5) —2(1 — ew") u(t) — 2e7" ut — 3) 


Compare this expression with the expression for the same function found in Eq. (1.14). 


EXERCISE E1.7 


Show that the signals depicted in Fig. 1.17a and 1.17b can be described as u(—t) and e “u(—t), respectively. 


&® (bo) 


Figure 1.17 


EXERCISE E1.8 
Show that the signal shown in Fig. 1.18 can be described as 


x(t) = (f — Dutt — 1) — @ —2)u¢ — 2) —utt — 4) 


Figure 1.18 


1.4-2 The Unit Impulse Function 6(t) 
The unit impulse function 8(f) is one of the most important functions in the study of signals and systems. This function was first defined 


by P. A. M. Dirac as 
d(1) =0 t#0 


/ 8(t)dt =1 (21) 


oO 
‘6 d(thdt=1 (1.21) 


We can visualize an impulse as a tall, narrow, rectangular pulse of unit area, as illustrated in Fig. 1.19b. The width of this rectangular 
pulse is a very small value € — 0. Consequently, its height is a very large value 1/e — o. The unit impulse therefore can be regarded 
as a rectangular pulse with a width that has become infinitesimally small, a height that has become infinitely large, and an overall area 
that has been maintained at unity. Thus 6(f) = 0 everywhere except at t = 0, where it is undefined. For this reason a unit impulse is 
represented by the spearlike symbol in Fig. 1.19a. 


bi) 


0 


(a) (b) 
Figure 1.19: A unit impulse and its approximation. 


Other pulses, such as the exponential, triangular, or Gaussian types, may also be used in impulse approximation. The important feature 
of the unit impulse function is not its shape but the fact that its effective duration (pulse width) approaches zero while its area remains at 


unity. For example, the exponential pulse we“ u(t) in Fig. 1.20a becomes taller and narrower as « increases. In the limit as « — 00, 
the pulse height — oo, and its width or duration — 0. Yet, the area under the pulse is unity regardless of the value of « because 


OO 
y ae“ dt=1 (1.22) 
0 


The pulses in Fig. 1.206 and 1.20c behave in a similar fashion. Clearly, the exact impulse function cannot be generated in practice; it 
can only be approached. 


fa (b) fc) 


Figure 1.20: Other possible approximations to a unit impulse. 


From Eq. (1.21), it follows that the function k8(t) = 0 for all t + 0, and its area is k. Thus, k8(t) is an impulse function whose area is k 


(in contrast to the unit impulse function, whose area is 1). 


MULTIPLICATION OF A FUNCTION BY AN IMPULSE 
Let us now consider what happens when we multiply the unit impulse 8(t) by a function ¢(t) that is known to be continuous at f = 0. 
Since the impulse has nonzero value only at t = 0, and the value of (t) at t = 0 is (0), we obtain 


d(t)d(t) = A(O)8(L) (1.23a) 


Thus, multiplication of a continuous-time function @(f) with an unit impulse located at t = 0 results in an impulse, which is located at t = 
0 and has strength (0) (the value of (ft) at the location of the impulse). Use of exactly the same argument leads to the generalization 
of this result, stating that provided (tf) is continuous at t= T, p(t) multiplied by an impulse 8(t — 7) (impulse located at t = T) results in 
an impulse located at t = T and having strength (7) [the value of (t) at the location of the impulse]. 


o(nad —T)=é(T)d —T) (1.23b) 


SAMPLING PROPERTY OF THE UNIT IMPULSE FUNCTION 
From Eq. (1.23a) it follows that 


oO oS 
/ P(td(t)dt = oo [ b(t) dt 
ss _ 
= (0) (1.24a) 


provided q(t) is continuous at t = 0. This result means that the area under the product of a function with an impulse 6(t) is equal to the 
value of that function at the instant at which the unit impulse is located. This property is very important and useful and is known as the 
sampling or sifting property of the unit impulse. 


From Eq. (1.23b) it follows that 


OO 
iy P(rjs(it —T)dt=(T) (1.24b) 


Equation (1.24b) is just another form of sampling or sifting property. In the case of Eq. (1.24b), the impulse 8(t¢ — 7) is located at t = T. 
Therefore, the area under $(t)(t — T) is (7), the value of (¢) at the instant at which the impulse is located (at t = T). In these 
derivations we have assumed that the function is continuous at the instant where the impulse is located. 


UNIT IMPULSE AS A GENERALIZED FUNCTION 
The definition of the unit impulse function given in Eq. (1.21) is not mathematically rigorous, which leads to serious difficulties. First, the 


impulse function does not define a unique function: for example, it can be shown that 8(t) + 8(f) also satisfies Eq. (1277.11 Moreover, 
8(t) is not even a true function in the ordinary sense. An ordinary function is specified by its values for all time t. The impulse function is 
zero everywhere except at t = 0, and at this, the only interesting part of its range, it is undefined. These difficulties are resolved by 
defining the impulse as a generalized function rather than an ordinary function. A generalized function is defined by its effect on other 
functions instead of by its value at every instant of time. 


In this approach the impulse function is defined by the sampling property [Eqs. (1.24)]. We say nothing about what the impulse function 
is or what it looks like. Instead, the impulse function is defined in terms of its effect on a test function (t). We define a unit impulse as 
a function for which the area under its product with a function (tf) is equal to the value of the function (tf) at the instant at which the 
impulse is located. It is assumed that }(t) is continuous at the location of the impulse. Therefore, either Eq. (1.24a) or (1.24b) can serve 
as a definition of the impulse function in this approach. Recall that the sampling property [Eqs. (1.24)] is the consequence of the 
classical (Dirac) definition of impulse in Eq. (1.21). In contrast, the sampling property [Eqs. (1.24)] defines the impulse function in the 
generalized function approach. 


We now present an interesting application of the generalized function definition of an impulse. Because the unit step function u(t) is 
discontinuous at f = 0, its derivative du/dt does not exist at t = 0 in the ordinary sense. We now show that this derivative does exist in 
the generalized sense, and it is, in fact, 5(t). As a proof, let us evaluate the integral of (du/dt)(t), using integration by parts: 


~ du ° ae : 
/ FP) at = uot) -f u(dp( dt (1.25) 
© . 
= ¢(00) —0-— p(t) dt 


J0 
= (00) — (1)|5° 
= $(0) 


This result shows that du/dt satisfies the sampling property of 6(t). Therefore it is an impulse 8(t) in the generalized sense-that is, 


du 


a a ae) (1.27) 
Consequently 
i 
f é(t)dt = u(t) (1.28) 


These results can also be obtained graphically from Fig. 1.19b. We observe that the area from — oo to ¢t under the limiting form of 8(t) 
in Fig. 1.19b is zero if t < —e€/2 and unity if t > €/2 with e — 0. Consequently 


a 0 +£<0 
[ aenar ‘ 1>0 


oo 


u(t) (1.29) 


This result shows that the unit step function can be obtained by integrating the unit impulse function. Similarly the unit ramp function x(t) 


= tu(t) can be obtained by integrating the unit step function. We may continue with unit parabolic function t2/2 obtained by integrating 
the unit ramp, and so on. On the other side, we have derivatives of impulse function, which can be defined as generalized functions 
(see Prob. 1.4-9). All these functions, derived from the unit impulse function (successive derivatives and integrals) are called singularity 


functions |T1 


EXERCISE E1.9 
Show that 


a. (f° + 3)8(t) = 38(t) 
sin (? ss =) S(t) = —8(1) 


c. e 2! &(t) = &(t) 


a? +1 


d. a2 +9 


5(m —1)= <3(w -1) 


EXERCISE E1.10 
Show that 


a. f° 0 &(t)e lt at = 1 


oo t 
th a(t — 2) cos (=) dt =0 
b. J-co 4 


C. fra 8 Ee 2X—-N§(2-# at =e72(*— 2) 


1.4-3 The Exponential Function eS‘ 


Another important function in the area of signals and systems is the exponential signal eS! where s is complex in general, given by 
s=o+ jw 


Therefore 


et = erie! = eel = e' (cos wt + j sin wf) (1.30a) 


Since s* = o — jw (the conjugate of s), then 


ent =e? /” = ee J™ = 0" (cos wt — j sin wf) (1.30b) 


and 
e* cos wt = t(e" +e") (1.30¢) 


Comparison of this equation with Euler's formula shows that e* is a generalization of the function e/t where the frequency variable jw 


is generalized to a complex variable s = o + jw. For this reason we designate the variable s as the complex frequency. From Eqs. 
(1.30) it follows that the function eS‘ encompasses a large class of functions. The following functions are either special cases of or can 
be expressed in terms of e°*: 


1. Aconstant k = ke®! (s = 0) 

2. A monotonic exponential ett (w =0,s=0) 

3. A sinusoid cos wt (o = 0, s = +/w) 

4. An exponentially varying sinusoid e% cos wt (s = o + jw) 


These functions are illustrated in Fig. 1.21. 


(c) (d) 


Figure 1.21: Sinusoids of complex frequency o + jw. 


The complex frequency s can be conveniently represented on a complex frequency plane (s plane) as depicted in Fig. 1.22. The 
horizontal axis is the real axis (o axis), and the vertical axis is the imaginary axis (jw axis). The absolute value of the imaginary part of 


S is |u| (the radian frequency), which indicates the frequency of oscillation of e*". the real part o (the neper frequency) gives 


information about the rate of increase or decrease of the amplitude of et. For signals whose complex frequencies lie on the real axis 
(o axis, where w = 0), the frequency of oscillation is zero. Consequently these signals are monotonically increasing or decreasing 


exponentials (Fig. 1.21a). For signals whose frequencies lie on the imaginary axis (jw axis where o = 0), e°! = 1. Therefore, these 
signals are conventional sinusoids with constant amplitude (Fig. 1.21b). The case s = 0 (o = w = 0) corresponds to a constant (dc) 


signal because e°! = 1. For the signals illustrated in Fig. 1.21c and 1.21d, both o and w are nonzero; the frequency s is complex and 
does not lie on either axis. The signal in Fig. 1.21c decays exponentially. Therefore, o is negative, and s lies to the left of the imaginary 
axis. In contrast, the signal in Fig. 1.21d grows exponentially. Therefore, o is positive, and s lies to the right of the imaginary axis. Thus 
the s plane (Fig. 1.21) can be separated into two parts: the /eft half-plane (LHP) corresponding to exponentially decaying signals and 
the right half-plane (RHP) corresponding to exponentially growing signals. The imaginary axis separates the two regions and 
corresponds to signals of constant amplitude. 


Left half-plane 


Exponentially decreasing signals 


Figure 1.22: Complex frequency plane. 


An exponentially growing sinusoid e2! cos 5t, for example, can be expressed as a linear combination of exponentials e(2+/5)t and 
e(2-J5)t with complex frequencies 2 + j5 and 2 — /5, respectively, which lie in the RHP. An exponentially decaying sinusoid e~2! cos 5t 
can be expressed as a linear combination of exponentials e(-2*/5)! and e(-2/5)t with complex frequencies —2 + j5 and-2 — 5, 
respectively, which lie in the LHP. A constant amplitude sinusoid cos 5t can be expressed as a linear combination of exponentials edt 


and e/°! with complex frequencies +/5, which lie on the imaginary axis. Observe that the monotonic exponentials e*2t are also 
generalized sinusoids with complex frequencies +2. 


[1]Papoulis, A. The Fourier Integral and Its Applications. McGraw-Hill, New York, 1962. 
[t] Singularity functions were defined by late Prof. S. J. Mason as follows. A singularity is a point at which a function does not possess a 
derivative. Each of the singularity functions (or if not the function itself, then the function differentiated a finite number of times) has a 


singular point at the origin and is zero elsewhere.!2] 


[tlMason, S. J. Electronic Circuits, Signals, and Systems. Wiley, New York, 1960. 


1.5 EVEN AND ODD FUNCTIONS 


A real function x9(f) is said to be an even function of t iflT] 


Xe(t) = x.(—1) (1.31) 
and a real function x(t) is said to be an odd function of t if 
X(t) = —Xo(—1) (1.32) 


An even function has the same value at the instants t and-t for all values of t. Clearly, x,(t) is symmetrical about the vertical axis, as 
shown in Fig. 1.23a. On the other hand, the value of an odd function at the instant tf is the negative of its value at the instant -t. 
Therefore, x(t) is antisymmetrical about the vertical axis, as depicted in Fig. 1.23b. 


(b) 
Figure 1.23: Functions of ft: (a) even and (b) odd. 


1.5-1 Some Properties of Even and Odd Functions 


Even and odd functions have the following properties: 
even function x odd function = odd function 


odd function x odd function = even function 
even function x even function = even function 
The proofs are trivial and follow directly from the definition of odd and even functions [Eqs. (1.31) and (1.32)]. 
AREA 
Because x,(f) is symmetrical about the vertical axis, it follows from Fig. 1.23a that 


a a 
[ xyar=2 f x.(t) dt (1.33a) 
= o 


a 


It is also clear from Fig. 1.23b that 


a 
/ x,(t)dt =0 (1.33b) 


a 


These results are valid under the assumption that there is no impulse (or its derivatives) at the origin. The proof of these statements is 
obvious from the plots of the even and the odd function. Formal proofs, left as an exercise for the reader, can be accomplished by 
using the definitions in Eqs. (1.31) and (1.32). 


Because of their properties, study of odd and even functions proves useful in many applications, as will become evident in later 
chapters. 


1.5-2 Even and Odd Components of a Signal 
Every signal x(t) can be expressed as a sum of even and odd components because 


x(t) = txt) +.(-1)) + HL) — x(-)] (1.34) 
a ee | Ne, ae” 


even odd 


From the definitions in Eqs. (1.31) and (1.32), we can clearly see that the first component on the right-hand side is an even function, 
while the second component is odd. This is apparent from the fact that replacing ¢ by -t in the first component yields the same function. 
The same maneuver in the second component yields the negative of that component. 


Consider the function 

x(t) =e “u(t) 

Expressing this function as a sum of the even and odd components x,(t) and x(t), we obtain 
x(t) = x-(t) + x.(0) 

where [from Eq. (1.34)] 


x(t) = t[e-“u(t) + e“u(—2)] (1.35a) 
and 
Xo(t) = Se" u(t) — e“u(-1)) (1.35b) 


The function e y(t) and its even and odd components are illustrated in Fig. 1.24. 


if) 
1 


Figure 1.24: Finding even and odd components of a signal. 


EXAMPLE 1.8 
Find the even and odd components of e/. 


From Eq. (1.34) 

e!" — Xl) + X,(t) 

where 

xe(t) = $fe# + e7"] =cos f 


and 
Xo(t) = Sle" —e"] = jsint 


[tla complex signal x(t) is said to be conjugate symmetrical if x(t) = x*(—t). A real conjugate symmetrical signal is an even signal. A 
signal is conjugate antisymmetrical if x(t) = —x*(—t). A real conjugate antisymmetrical signal is an odd signal. 


1.6 SYSTEMS 


As mentioned in Section 1.1, systems are used to process signals to allow modification or extraction of additional information from the 
signals. A system may consist of physical components (hardware realization) or of an algorithm that computes the output signal from the 
input signal (software realization). 


Roughly speaking, a physical system consists of interconnected components, which are characterized by their terminal (input-output) 
relationships. In addition, a system is governed by laws of interconnection. For example, in electrical systems, the terminal relationships 
are the familiar voltage-current relationships for the resistors, capacitors, inductors, transformers, transistors, and so on, as well as the 
laws of interconnection (i.e., Kirchhoffs laws). Using these laws, we derive mathematical equations relating the outputs to the inputs. 
These equations then represent a mathematical model of the system. 


A system can be conveniently illustrated by a "black box" with one set of accessible terminals where the input variables x4(t), x2(t),..., 
x;(t) are applied and another set of accessible terminals where the output variables y4(t), yo(t),..., yx(t) are observed (Fig. 1.25). 


x() —— —e— y,(1 
x(t) —— —e— y,(t) 
x;(t) —— —~— y,(t) 


Figure 1.25: Representation of a system. 


The study of systems consists of three major areas: mathematical modeling, analysis, and design. Although we shall be dealing with 
mathematical modeling, our main concern is with analysis and design. The major portion of this book is devoted to the analysis 
problem-how to determine the system outputs for the given inputs and a given mathematical model of the system (or rules governing 
the system). To a lesser extent, we will also consider the problem of design or synthesis-how to construct a system that will produce a 
desired set of outputs for the given inputs. 


DATA NEEDED TO COMPUTE SYSTEM RESPONSE 
To understand what data we need to compute a system response, consider a simple RC circuit with a current source x(t) as its input 
(Fig. 1.26). The output voltage y(t) is given by 


1 t 
yi) = Rx) +e f x(t)dt (1.36a) 


Figure 1.26: Example of a simple electrical system. 


The limits of the integral on the right-hand side are from — oo to ¢t because this integral represents the capacitor charge due to the 
current x(t) flowing in the capacitor, and this charge is the result of the current flowing in the capacitor from — oo. Now, Eq. (1.36a) can 
be expressed as 


A i 
yi) = Re += | x(n)dr += | x(t)dt (1.36b) 
C Sx C Jo 
The middle term on the right-hand side is vc(0), the capacitor voltage at t = 0. Therefore 
1 f 
Yt) = ve(0) + Rx) +z f x(r)dt t>0 (1.36¢) 
This equation can be readily generalized as 
l i 
y(t) = uc (ho) + RX + c x(t)dt {> (1.36d) 
fs 


From Eq. (1.36a), the output voltage y(t) at an instant t can be computed if we know the input current flowing in the capacitor 
throughout its entire past (— © to f). Alternatively, if we know the input current x(t) from some moment fo onward, then, using Eq. 


(1.36d), we can still calculate y(t) for t > t° from a knowledge of the input current, provided we know Vc(to), the initial capacitor voltage 
(voltage at fo). Thus v¢(tg) contains all the relevant information about the circuit's entire past (— oo to fg) that we need to compute y(f) 
for t => tg. Therefore, the response of a system at tf = tg can be determined from its input(s) during the interval fo to t and from certain 
initial conditions at t = to. 


In the preceding example, we needed only one initial condition. However, in more complex systems, several initial conditions may be 


necessary. We know, for example, that in passive RLC networks, the initial values of all inductor currents and all capacitor voltages!T] 
are needed to determine the outputs at any instant tf = 0 if the inputs are given over the interval [0, ¢]. 


[T] Strictly speaking, this means independent inductor currents and capacitor voltages. 


1.7 CLASSIFICATION OF SYSTEMS 


Systems may be classified broadly in the following categories: 

1. Linear and nonlinear systems 
Constant-parameter and time-varying-parameter systems 
Instantaneous (memoryless) and dynamic (with memory) systems 
Causal and noncausal systems 
Continuous-time and discrete-time systems 
Analog and digital systems 


Invertible and noninvertible systems 


ON Oe or ee ee TS 


Stable and unstable systems 


Other classifications, such as deterministic and probabilistic systems, are beyond the scope of this text and are not considered. 


1.7-1 Linear and Nonlinear Systems 


THE CONCEPT OF LINEARITY 

A system whose output is proportional to its input is an example of a linear system. But linearity implies more than this; it also implies 

the additivity property: that is, if several inputs are acting on a system, then the total effect on the system due to all these inputs can be 

determined by considering one input at a time while assuming all the other inputs to be zero. The total effect is then the sum of all the 

component effects. This property may be expressed as follows: for a linear system, if an input x; acting alone has an effect y;, and if 

another input x2, also acting alone, has an effect yz, then, with both inputs acting on the system, the total effect will be y; + yo. Thus, if 
xX) — ¥; and X2— jr (1.37) 


then for all x4 and x2 
X) +X. —> VW +2 (1.38) 
In addition, a linear system must satisfy the homogeneity or scaling property, which states that for arbitrary real or imaginary number k, 
if an input is increased k-fold, the effect also increases k-fold. Thus, if 
— Fy 
then for all real or imaginary k 


kx —> ky (1.39) 


Thus, linearity implies two properties: homogeneity (scaling) and additivity [1] Both these properties can be combined into one property 
(superposition), which is expressed as follows: If 
yy and 2 y 


then for all values of constants k; and ko, 
KX, + koX, —> kin + kayr (1.40) 
This is true for all x4 and xo. 


It may appear that additivity implies homogeneity. Unfortunately, homogeneity does not always follow from additivity. Exercise E1.11 


demonstrates such a case. 


EXERCISE E1.11 
Show that a system with the input x(t) and the output y(t) related by y(t) = Re{x(t)} satisfies the additivity property but violates the 
homogeneity property. Hence, such a system is not linear. 


[Hint: Show that Eq. (1.39) is not satisfied when k is complex.] 


RESPONSE OF A LINEAR SYSTEM 
For the sake of simplicity, we discuss only single-input, single-output (SISO) systems. But the discussion can be readily extended to 
multiple-input, multiple-output (MIMO) systems. 


A system's output for t > 0 is the result of two independent causes: the initial conditions of the system (or the system state) at t = 0 
and the input x(t) for tf => 0. If a system is to be linear, the output must be the sum of the two components resulting from these two 
causes: first, the zero-input response component that results only from the initial conditions at f = 0 with the input x(t) = 0 for f= 0, and 
then the zero-state response component that results only from the input x(t) for f = 0 when the initial conditions (at f = 0) are assumed 
to be zero. When all the appropriate initial conditions are zero, the system is said to be in zero state. The system output is zero when 
the input is zero only if the system is in zero state. 


In summary, a linear system response can be expressed as the sum of the zero-input and the zero-state component: 
total response = zero-input response + zero-state response (1.41) 


This property of linear systems, which permits the separation of an output into components resulting from the initial conditions and from 
the input, is called the decomposition property. 


For the RC circuit of Fig. 1.26, the response y(t) was found to be [see Eq. (1.36c)] 


1 I 
yQ)= vuce(O) +Rx(t)+ =/ x(t)dt (1.42) 
=” C Jo 
cpt OT 
I — £ component 


From Eq. (1.42), it is clear that if the input x(t) = 0 for tf => O, the output y(t) = vc(0). Hence v¢(0) is the zero-input component of the 
response y(t). Similarly, if the system state (the voltage vc in this case) is zero at tf = 0, the output is given by the second component 
on the right-hand side of Eq. (1.42). Clearly this is the zero-state component of the response y(t). 


In addition to the decomposition property, linearity implies that both the zero-input and zero-state components must obey the principle 
of superposition with respect to each of their respective causes. For example, if we increase the initial condition k-fold, the zero-input 
component must also increase k-fold. Similarly, if we increase the input k-fold, the zero-state component must also increase k-fold. 
These facts can be readily verified from Eq. (1.42) for the RC circuit in Fig. 1.26. For instance, if we double the initial condition vc(0), 
the zero-input component doubles; if we double the input x(t), the zero-state component doubles. 


EXAMPLE 1.9 

Show that the system described by the equation 
dy 
— + 3y(t) = x(t) (1.43) 
dt 

is linear] 


Let the system response to the inputs x,(f) and x(t) be y4(f) and yo(t), respectively. Then 
dy, 
— + 3yi(t) = xi (t) 
dt 

and 

dy> : 
— + 3yo(t) = x2(t) 
dt 7 


Multiplying the first equation by kj, the second with ky, and adding them yields 
d 

qn) + kyy2(t)] + 3fki yi (0) + koy2(t)] = kixi(t) + kex0(t) 

But this equation is the system equation [Eq. (1.43)] with 

x(t) =kixi(t) + howl) 


and 


y(t) = kyyi(t) + kayo(t) 


Therefore, when the input is k,x4(t) + k2Xx9(t), the system response is k1y4(t) + koy2(t). Consequently, the system is linear. Using this 
argument, we can readily generalize the result to show that a system described by a differential equation of the form 
d*y arnty d*x d 


: 
+s ++ t+ ayylt) = by_yw— +--+ byiz +bhyx(t) (144) 


1—_ 
ae a ai d 


is a linear system. The coefficients a; and 6; in this equation can be constants or functions of time. Although here we proved only zero- 
state linearity, it can be shown that such systems are also zero-input linear and have the decomposition property. 


EXERCISE E1.12 

Show that the system described by the following equation is linear: 
dy 4 , 

— +f y(t) = (28+ 3)x0) 

dt 

EXERCISE E1.13 

Show that the system described by the following equation is nonlinear: 


yn + 3y{t) = x{t) 
at 


MORE COMMENTS ON LINEAR SYSTEMS 

Almost all systems observed in practice become nonlinear when large enough signals are applied to them. However, it is possible to 
approximate most of the nonlinear systems by linear systems for small-signal analysis. The analysis of nonlinear systems is generally 
difficult. Nonlinearities can arise in so many ways that describing them with a common mathematical form is impossible. Not only is 
each system a category in itself, but even for a given system, changes in initial conditions or input amplitudes may change the nature 
of the problem. On the other hand, the superposition property of linear systems is a powerful unifying principle that allows for a general 
solution. The superposition property (linearity) greatly simplifies the analysis of linear systems. Because of the decomposition property, 
we can evaluate separately the two components of the output. The zero-input component can be computed by assuming the input to be 
zero, and the zero-state component can be computed by assuming zero initial conditions. Moreover, if we express an input x(f) as a 
sum of simpler functions, . 

XQ) = QyX(E) + 2X20) + +++ + Om Xm) 


then, by virtue of linearity, the response y(t) is given by 


y(t) = ay y(t) + doyo(t) + +++ + Gn Vat) (1.45) 


where y;,(t) is the zero-state response to an input x;(¢). This apparently trivial observation has profound implications. As we shall see 
repeatedly in later chapters, it proves extremely useful and opens new avenues for analyzing linear systems. 


For example, consider an arbitrary input x(t) such as the one shown in Fig. 1.27a. We can approximate x(t) with a sum of rectangular 
pulses of width At and of varying heights. The approximation improves as At — 0, when the rectangular pulses become impulses 


spaced At seconds apart (with At — 0).[1] Thus, an arbitrary input can be replaced by a weighted sum of impulses spaced At (At — 0) 
seconds apart. Therefore, if we know the system response to a unit impulse, we can immediately determine the system response to an 
arbitrary input x(t) by adding the system response to each impulse component of x(t). A similar situation is depicted in Fig. 1.27b, 
where x(t) is approximated by a sum of step functions of varying magnitude and spaced At seconds apart. The approximation improves 
as At becomes smaller. Therefore, if we know the system response to a unit step input, we can compute the system response to any 
arbitrary input x(t) with relative ease. Time-domain analysis of linear systems (discussed in Chapter 2) uses this approach. 


{ap (b) 


Figure 1.27: Signal representation in terms of impulse and step components. 


Chapters 4 through 7 employ the same approach but instead use sinusoids or exponentials as the basic signal components. We show 
that any arbitrary input signal can be expressed as a weighted sum of sinusoids (or exponentials) having various frequencies. Thus a 
knowledge of the system response to a sinusoid enables us to determine the system response to an arbitrary input x(t). 


1.7-2 Time-Invariant and Time-Varying Systems 


Systems whose parameters do not change with time are time-invariant (also constant-parameter) systems. For such a system, if the 


input is delayed by T seconds, the output is the same as before but delayed by 7 (assuming initial conditions are also delayed by 7). 
This property is expressed graphically in Fig. 1.28. We can also illustrate this property, as shown in Fig. 1.29. We can delay the output 
y(t) of a system S by applying the output y(t) to a T second delay (Fig. 1.29a). If the system is time invariant, then the delayed output 
y(t — T) can also be obtained by first delaying the input x(t) before applying it to the system, as shown in Fig. 1.29b. In other words, the 
system S and the time delay commute if the system S is time invariant. This would not be true for time-varying systems. Consider, for 


instance, a time-varying system specified by y(t) = e~'x(t). The output for such a system in Fig. 1.29a is e(t- x(t — T). In contrast, 
the output for the system in Fig. 1.29b is e x(t — T). 
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Figure 1.28: Time-invariance property. 
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(b) 
Figure 1.29: lllustration of time-invariance property. 


It is possible to verify that the system in Fig. 1.26 is a time-invariant system. Networks composed of RLC elements and other commonly 
used active elements such as transistors are time-invariant systems. A system with an input-output relationship described by a linear 
differential equation of the form given in Example 1.9 [Eq. (1.44)] is a linear time-invariant (LTI) system when the coefficients a; and b; 
of such equation are constants. If these coefficients are functions of time, then the system is a linear time-varying system. 


The system described in Exercise E1.12 is linear time varying. Another familiar example of a time-varying system is the carbon 
microphone, in which the resistance R is a function of the mechanical pressure generated by sound waves on the carbon granules of 
the microphone. The output current from the microphone is thus modulated by the sound waves, as desired. 


EXERCISE E1.14 
Show that a system described by the following equation is time-varying-parameter system: 
y(t) = (sin x(t — 2) 


[Hint: Show that the system fails to satisfy the time-invariance property.] 


1.7-3 Instantaneous and Dynamic Systems 


As observed earlier, a system's output at any instant f generally depends on the entire past input. However, in a special class of 
systems, the output at any instant t depends only on its input at that instant. In resistive networks, for example, any output of the 
network at some instant t depends only on the input at the instant f. In these systems, past history is irrelevant in determining the 
response. Such systems are said to be instantaneous or memoryless systems. More precisely, a system is said to be instantaneous (or 
memoryless) if its output at any instant t depends, at most, on the strength of its input(s) at the same instant f, and not on any past or 
future values of the input(s). Otherwise, the system is said to be dynamic (or a system with memory). A system whose response at f is 
completely determined by the input signals over the past T seconds [interval from (tf — 7) to ¢] is a finite-memory system with a memory 
of T seconds. Networks containing inductive and capacitive elements generally have infinite memory because the response of such 


networks at any instant f is determined by their inputs over the entire past (— ©, f). This is true for the RC circuit of Fig. 1.26. 


In this book we will generally examine dynamic systems. Instantaneous systems are a special case of dynamic systems. 


1.7-4 Causal and Noncausal Systems 


A causal (also known as a physical or nonanticipative) system is one for which the output at any instant tg depends only on the value of 
the input x(t) for f < tg. In other words, the value of the output at the present instant depends only on the past and present values of 
the input x(t), not on its future values. To put it simply, in a causal system the output cannot start before the input is applied. If the 
response starts before the input, it means that the system knows the input in the future and acts on this knowledge before the input is 
applied. A system that violates the condition of causality is called a noncausal (or anticipative) system. 


Any practical system that operates in real time!T] must necessarily be causal. We do not yet know how to build a system that can 
respond to future inputs (inputs not yet applied). A noncausal system is a prophetic system that knows the future input and acts on it in 
the present. Thus, if we apply an input starting at {= O to a noncausal system, the output would begin even before t = O. For example, 
consider the system specified by 


y(t) = x(t —2) + x(t +2) (1.46) 


For the input x(f) illustrated in Fig. 1.30a, the output y(t), as computed from Eq. (1.46) (shown in Fig. 1.30b), starts even before the 
input is applied. Equation (1.46) shows that y(t), the output at f, is given by the sum of the input values 2 seconds before and 2 
seconds after ¢ (at t — 2 andt+ 2, respectively). But if we are operating the system in real time at ft, we do not know what the value of 
the input will be 2 seconds later. Thus it is impossible to implement this system in real time. For this reason, noncausal systems are 
unrealizable in real time. 
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Figure 1.30: A noncausal system and its realization by a delayed causal system. 


WHY STUDY NONCAUSAL SYSTEMS? 


The foregoing discussion may suggest that noncausal systems have no practical purpose. This is not the case; they are valuable in the 
study of systems for several reasons. First, noncausal systems are realizable when the independent variable is other than "time" (e.g., 
space). Consider, for example, an electric charge of density q(x] placed along the x axis for x > O. This charge density produces an 
electric field E(x) that is present at every point on the x axis from x = — © to o. In this case the input [i.e., the charge density q(x)] 
starts at x = O, but its output [the electric field E(x)] begins before x = O. Clearly, this space-charge system is noncausal. This 
discussion shows that only temporal systems (systems with time as independent variable) must be causal to be realizable. The terms 
"before" and "after" have a special connection to causality only when the independent variable is time. This connection is lost for 
variables other than time. Nontemporal systems, such as those occurring in optics, can be noncausal and still realizable. 


Moreover, even for temporal systems, such as those used for signal processing, the study of noncausal systems is important. In such 
systems we may have all input data prerecorded. (This often happens with speech, geophysical, and meteorological signals, and with 
space probes.) In such cases, the input's future values are available to us. For example, suppose we had a set of input signal records 
available for the system described by Eq. (1.46). We can then compute y(t) since, for any t, we need only refer to the records to find 
the input's value 2 seconds before and 2 seconds after t. Thus, noncausal systems can be realized, although not in real time. We may 
therefore be able to realize a noncausal system, provided we are willing to accept a time delay in the output. Consider a system whose 
eras Y(t) is a as y(t) in Eq. (1.46) delayed by 2 seconds (Fig 1.30c), so that 

(tf) = y(t — 2) 


= x(t-—4)4+ x(t) 


Here the value of the output Y at any instant tis the sum of the values of the input x at t and at the instant 4 seconds earlier [at (t — 
4)]. In this case, the output at any instant f does not depend on future values of the input, and the system is causal. The output of this 


system, which is Y(t), is identical to that in Eq. (1.46) or Fig. 1.30b except for a delay of 2 seconds. Thus, a noncausal system may be 
realized or satisfactorily approximated in real time by using a causal system with a delay. 


TELS ME WHAT THE] TIME To 
STOCKS wut Be \_ Divine 
| DOING A YEAR 


} 
f \ 
\ Faon NOW, 


Noncausal systems are realizable with time delay! 


A third reason for studying noncausal systems is that they provide an upper bound on the performance of causal systems. For example, 
if we wish to design a filter for separating a signal from noise, then the optimum filter is invariably a noncausal system. Although 
unrealizable, this noncausal system's performance acts as the upper limit on what can be achieved and gives us a standard for 
evaluating the performance of causal filters. 


At first glance, noncausal systems may seem to be inscrutable. Actually, there is nothing mysterious about these systems and their 
approximate realization through physical systems with delay. If we want to know what will happen one year from now, we have two 
choices: go to a prophet (an unrealizable person) who can give the answers instantly, or go to a wise man and allow him a delay of one 
year to give us the answer! If the wise man is truly wise, he may even be able, by studying trends, to shrewdly guess the future very 
closely with a delay of less than a year. Such is the case with noncausal systems-nothing more and nothing less. 


EXERCISE E1.15 
Show that a system described by the following equation is noncausal: 


yin= f “x(t)dt 
2—§ 


Show that this system can be realized physically if we accept a delay of 5 seconds in the output. 


1.7-5 Continuous-Time and Discrete-Time Systems 


Signals defined or specified over a continuous range of time are continuous-time signals, denoted by symbols x(t), y(t), and so on. 
Systems whose inputs and outputs are continuous-time signals are continuous-time systems. On the other hand, signals defined only at 
discrete instants of time fo, t4, t,... are discrete-time signals, denoted by the symbols x(t,), y(tn), and so on, where rn is some integer. 
Systems whose inputs and outputs are discrete-time signals are discrete-time systems. A digital computer is a familiar example of this 
type of system. In practice, discrete-time signals can arise from sampling continuous-time signals. For example, when the sampling is 
uniform, the discrete instants to, t4, t2,... are uniformly spaced so that 

hoy ~h =T for all k 


In such case, the discrete-time signals represented by the samples of continuous-time signals x(t), y(t), and so on can be expressed as 
X(nT), y(nT), and so on; for convenience, we further simplify this notation to x[n], y[nT],..., where it is understood that x[n] = x(nT) and 
that n is some integer. A typical discrete-time signal is shown in Fig. 1.31. A discrete-time signal may also be viewed as a sequence of 
numbers..., x[— 1], x[0], x[1], x[2],.... Thus a discrete-time system may be seen as processing a sequence of numbers x[n] and yielding 
as an output another sequence of numbers y[n]. 


x[v] | or x(nT) 
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Figure 1.31: A discrete-time signals. 


Discrete-time signals arise naturally in situations that are inherently discrete time, such as population studies, amortization problems, 
national income models, and radar tracking. They may also arise as a result of sampling continuous-time signals in sampled data 
systems, digital filtering, and the like. Digital filtering is a particularly interesting application in which continuous-time signals are 
processed by using discrete-time systems as shown in Fig. 1.32. A continuous-time signal x(t) is first sampled to convert it into a 
discrete-time signal x[n], which then is processed by the discrete-time system to yield a discrete-time output y[n]. A continuous-time 
signal y(t) is finally constructed from y[n]. In this manner we can process a continuous-time signal with an appropriate discrete-time 


system such as a digital computer. Because discrete-time systems have several significant advantages over continuous-time systems. 
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Figure 1.32: Processing contiuous-time signals by discrete-time system. 


1.7-6 Analog and Digital Systems 


Analog and digital signals are discussed in Section 1.3-2. A system whose input and output signals are analog is an analog system; a 
system whose input and output signals are digital is a digital system. A digital computer is an example of a digital (binary) system. 
Observe that a digital computer is digital as well as a discrete-time system. 


1.7-7 Invertible and Noninvertible Systems 


A system S performs certain operation(s) on input signal(s). If we can obtain the input x(t) back from the corresponding output y(t) by 
some operation, the system S is said to be invertible. When several different inputs result in the same output (as in a rectifier), it is 
impossible to obtain the input from the output, and the system is noninvertible. Therefore, for an invertible system, it is essential that 
every input have a unique output so that there is a one-to-one mapping between an input and the corresponding output. The system 
that achieves the inverse operation [of obtaining x(t) from y(t)] is the inverse system for S. For instance, if S is an ideal integrator, then 
its inverse system is an ideal differentiator. Consider a system S connected in tandem with its inverse S;, as shown in Fig. 1.33. The 
input x(t) to this tandem system results in signal y(t) at the output of S, and the signal y(t), which now acts as an input to Sj, yields 
back the signal x(t) at the output of S;, Thus, Sj, undoes the operation of S on x(t), yielding back x(t). A system whose output is equal 
to the input (for all possible inputs) is an identity system. Cascading a system with its inverse system, as shown in Fig. 1.33, results in 
an identity system. 
x1) yD y x(t) 
RS Sle 


Figure 1.33: A cascade of a system with its inverse results in an identity system. 
In contrast, a rectifier, specified by an equation y(t) = |x(t)|, is noninvertibe because the rectification operation cannot be undone. 


Inverse systems are very important in signal processing. In many applications, the signals are distorted during the processing, and it is 
necessary to undo the distortion. For instance, in transmission of data over a communication channel, the signals are distorted owing to 
nonideal frequency response and finite bandwidth of a channel. It is necessary to restore the signal as closely as possible to its original 
shape. Such equalization is also used in audio systems and photographic systems. 


1.7-8 Stable and Unstable Systems 


Systems can also be classified as stable or unstable systems. Stability can be internal or external. If every bounded input applied at the 
input terminal results in a bounded output, the system is said to be stable externally. The external stability can be ascertained by 
measurements at the external terminals (input and output) of the system. This type of stability is also known as the stability in the BIBO 
(bounded-input/bounded-output) sense. The concept of internal stability is postponed to Chapter 2 because it requires some 
understanding of internal system behavior, introduced in that chapter. 


EXERCISE E1.16 
Show that a system described by the equation y(t) = x(t) is noninvertible but BIBO stable. 


[t]A linear system must also satisfy the additional condition of smoothness, where small changes in the system's inputs must result in 
small changes in its outputs. [3] 


[tlkailath, T. Linear Systems. Prentice-Hall, Englewood Cliffs, NJ, 1980. 
[tlEquations such as (1.43) and (1.44) are considered to represent linear systems in the classical definition of linearity. Some authors 


consider such equations to represent incrementally linear systems. According to this definition, linear system has only a zero-state 
component. The zero-input component is absent. Hence, incrementally linear system response can be represented as a response of a 


linear system (linear in this new definition) plus a zero-input component. We prefer the classical definition to this new definition. It is just 
a matter of definition and makes no difference in the final results. 


[tlHere, the discussion of a rectangular pulse approaching an impulse at At — 0 is somewhat imprecise. It is explained in Section 2.4 
with more rigor. 


[Tin real-time operations, the response to an input is essentially simultaneous (contemporaneous) with the input itself. 


1.8 SYSTEM MODEL: INPUT-OUTPUT DESCRIPTION 


A system description in terms of the measurements at the input and output terminals is called the input-output description. As 
mentioned earlier, systems theory encompasses a variety of systems, such as electrical, mechanical, hydraulic, acoustic, 
electromechanical, and chemical, as well as social, political, economic, and biological. The first step in analyzing any system is the 
construction of a system model, which is a mathematical expression or a rule that satisfactorily approximates the dynamical behavior of 
the system. In this chapter we shall consider only continuous-time systems. (Modeling of discrete-time systems is discussed in Chapter 
3.) 


1.8-1 Electrical Systems 


To construct a system model, we must study the relationships between different variables in the system. In electrical systems, for 
example, we must determine a satisfactory model for the voltage-current relationship of each element, such as Ohm's law for a resistor. 
In addition, we must determine the various constraints on voltages and currents when several electrical elements are interconnected. 
These are the laws of interconnection-the well-known Kirchhoff laws for voltage and current (KVL and KCL). From all these equations, 
we eliminate unwanted variables to obtain equation(s) relating the desired output variable(s) to the input(s). The following examples 
demonstrate the procedure of deriving input-output relationships for some LTI electrical systems. 


EXAMPLE 1.10 
For the series RLC circuit of Fig. 1.34, find the input-output equation relating the input voltage x(t) to the output current (loop current) 
y(t). 


L=1H R=30 


Figure 1.34 


Application of Kirchhoff's voltage law around the loop yields 


u(t) + ur(t) + vc (t) = x(t) (1.47) 


By using the voltage-current laws of each element (inductor, resistor, and capacitor), we can express this equation as 
dy . 
— + 3y(t) +2 y(t)dt = x(t) (1.48) 
dt ~00 


Differentiating both sides of this equation, we obtain 


d’y dy ax 
a ones ay = — : 
og $35- +2y(t) = = (1.49) 


This differential equation is the input-output relationship between the output y(t) and the input x(f). 


It proves convenient to use a compact notation D for the differential operator d/dt. Thus 


—= Dy 1.50 
a y(t) ( ) 


—— = D*y(t) (1.51) 


and so on. With this notation, Eq. (1.49) can be expressed as 


(D> + 3D + 2)y(t) = Dx(t) (1.52) 
The differential operator is the inverse of the integral operator, so we can use the operator 1/D to represent integration. [tT] 
‘ 1 
i y(t)dt = —y(t) (1.53) 
a0 D 
Consequently, the loop equation (1.48) can be expressed as 
2 
D+3+5 y(t) = x(t) (1.54) 


Multiplying both sides by D, that is, differentiating Eq. (1.54), we obtain 


(D? + 3D + 2)y(t) = Dx(t) (1.55) 
which is identical to Eq. (1.52). 


Recall that Eq. (1.55) is not an algebraic equation, and D2 + 3D +2 is not an algebraic term that multiplies y(t); it is an operator that 
operates on y(t). It means that we must perform the following operations on y(t): take the second derivative of y(t) and add to it 3 times 
the first derivative of y(t) and 2 times y(t). Clearly, a polynomial in D multiplied by y(t) represents a certain differential operation on y(‘). 


EXAMPLE 1.11 


Find the equation relating the input to output for the series RC circuit of Fig. 1.35 if the input is the voltage x(t) and output is 


a. the loop current i(t) 


b. the capacitor voltage y(t) 
R=150 


x(t) 


Figure 1.35 


a. The loop equation for the circuit is 


a 
Ria + f i(t)dr = x(t) (1.56) 
C Jos 


or 


f 
si +5 [ i(t)dt =x(t) (1.57) 


With operational notation, this equation can be expressed as 


151) + 21) = 209 (1.58) 


b. Multiplying both sides of Eqs. (1.58) by D (i.e., differentiating the equation), we obtain 


(ISD + 5)i(t) = Dx(t) (1.59a) 


or 
di 
— +5i(t) = — c 
57, + 5i(f) a (1.59b) 
Moreover, 
dy 
i(t)=C— 
i(f) at 
= £Dy(t) 
Substitution of this result in Eq. (1.59a) yields 
(3D + I)y(t) = x(t) (1.60) 
or 
dy 
3 + y(t) = x(t) (1.61) 


EXERCISE E1.17 


For the RLC circuit in Fig. 1.34, find the input-output relationship if the output is the inductor voltage v, (f). 9 


= 
Answers 


(D2 + 3D + 2)v,(t) = D2x(t) 


EXERCISE E1.18 


For the RLC circuit in Fig. 1.34, find the input-output relationship if the output is the capacitor voltage v,(tf). BF 


= 
Answers 


(D2 + 3D + 2)v,(t) = 2x(t) 


1.8-2 Mechanical Systems 


Planar motion can be resolved into translational (rectilinear) motion and rotational (torsional) motion. Translational motion will be 
considered first. We shall restrict ourselves to motions in one dimension. 


Translational Systems 


The basic elements used in modeling translational systems are ideal masses, linear springs, and dashpots providing viscous damping. 
The laws of various mechanical elements are now discussed. 


For a mass M (Fig. 1.36a), a force x(t) causes a motion y(t) and acceleration y(t). From Newton's law of motion, 


dy ' 
x(0) = MS) = MZ = MD*y) (1.62) 
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Figure 1.36: Some elements in translational mechanical systems. 


The force x(t) required to stretch (or compress) a /inear spring (Fig. 1.36b) by an amount y(f) is given by 


x(t) = Ky(t) (1.63) 
where K is the stiffness of the spring. 


For a linear dashpot (Fig. 1.36c), which operates by virtue of viscous friction, the force moving the dashpot is proportional to the relative 
velocity y(t) of one surface with respect to the other. Thus 


; dy 
x(t) = By(t)= — BDy(t) (1.64) 
where B is the damping coefficient of the dashpot or the viscous friction. 


EXAMPLE 1.12 
Find the input-output relationship for the translational mechanical system shown in Fig. 1.37a or its equivalent in Fig. 1.37b. The input 
is the force x(t), and the output is the mass position y(t). 


In mechanical systems it is helpful to draw a free-body diagram of each junction, which is a point at which two or more elements are 
connected. In Fig. 1.37, the point representing the mass is a junction. The displacement of the mass is denoted by y(t). The spring is 
also stretched by the amount y(t), and therefore it exerts a force-Ky(t) on the mass. The dashpot exerts a force-By(t) on the mass as 
shown in the free-body diagram (Fig. 1.37c). By Newton's second law, the net force must be My(t). Therefore 


M¥(t) = —BS(t) — Ky(t) + x(0) 
or 


(MD? + BD + K)y(t) = x(t) (1.65) 


Figure 1.37 


Rotational Systems 


In rotational systems, the motion of a body may be defined as its motion about a certain axis. The variables used to describe rotational 
motion are torque (in place of force), angular position (in place of linear position), angular velocity (in place of linear velocity), and 
angular acceleration (in place of linear acceleration). The system elements are rotational mass or moment of inertia (in place of mass) 
and torsional springs and torsional dashpots (in place of linear springs and dashpots). The terminal equations for these elements are 
analogous to the corresponding equations for translational elements. If J is the moment of inertia (or rotational mass) of a rotating body 
about a certain axis, then the external torque required for this motion is equal to J (rotational mass) times the angular acceleration. If 0 
is the angular position of the body, Gis its angular acceleration, and 


> 


dé > 
-~=JD*6(t) (1.66) 
di? 


torque = JO = J 


Similarly, if K is the stiffness of a torsional spring (per unit angular twist), and @ is the angular displacement of one terminal of the spring 
with respect to the other, then 


torque = K@ (1.67) 


Finally, the torque due to viscous damping of a torsional dashpot with damping coefficient B is 


torque = BO(1) = BDA(t) (1.68) 


EXAMPLE 1.13 

The attitude of an aircraft can be controlled by three sets of surfaces (shown shaded in Fig. 1.38): elevators, rudder, and ailerons. By 
manipulating these surfaces, one can set the aircraft on a desired flight path. The roll angle @ can be controlled by deflecting in the 
opposite direction the two aileron surfaces as shown in Fig. 1.38. Assuming only rolling motion, find the equation relating the roll angle 


¢ to the input (deflection) 8. 
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Figure 1.38: Attitude control of an airplane. 


The aileron surfaces generate a torque about the roll axis proportional to the aileron deflection angle 8. Let this torque be cO, where c 
is the constant of proportionality. Air friction dissipates the torque Bt). The torque available for rolling motion is then 
cO(t) — BP(1). tf Jis the moment of inertia of the plane about the x axis (roll axis), then 


J@(t) = net torque 


= cO(t) — By(t) (1.69) 
and 
ay dy 
J at = c(t) (1.70) 
or 
(JD? + BD)g(t) = c0(t) (1.71) 


This is the desired equation relating the output (roll angle ¢) to the input (aileron angle 8). 


The roll velocity w is ptt ) If the desired output is the roll velocity w rather than the roll angle o, then the input-output equation would 
be 


gue + Ba =cé (1.72) 
dt 
or 
(JD + B)w(t) = cO(t) (1.73) 


EXERCISE E1.19 


Torque 7 (ft) is applied to the rotational mechanical system shown in Fig. 1.39a. The torsional spring 

stiffness is K; the rotational mass (the cylinder's moment of inertia about the shaft) is J; the viscous damping * 
coefficient between the cylinder and the ground is B. Find the equation relating the output angle @ to the 

input torque 7. [Hint: A free-body diagram is shown in Fig. 1.39b.] 
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Figure 1.39: Rotational system. 


Answers 

ae dé 

=e cae a] _ 
J +B + Ké(t)= T(t) 


or 


(JD? + BD+ K)@(t) = Tit) 


1.8-3 Electromechanical Systems 


A wide variety of electromechanical systems convert electrical signals into mechanical motion (mechanical energy) and vice versa. Here 
we consider a rather simple example of an armaturecontrolled dc motor driven by a current source x(t), as shown in Fig. 1.40a. The 
torque ‘7 (t) generated in the motor is proportional to the armature current x(t). Therefore 


T(t) = Krx(t) (1.74) 


(a) ib) 
Figure 1.40: Armature-controlled dc motor. 


where Ky is a constant of the motor. This torque drives a mechanical load whose free-body diagram is shown in Fig. 1.40b. The 
viscous damping (with coefficient B) dissipates a torque B@ (1). if J is the moment of inertia of the load (including the rotor of the 
motor), then the net torque 7 (¢) — B@(t) must be equal to J@(P): 


J6(t) = T(t) — Be(t) (1.75) 
Thus 


(JD? + BD)O(t) = T(t) 
= Krx(t) (1.76) 


which in conventional form can be expressed as 


720 pl? Krxi (1.77) 

a= => f= a X(t) 2 

ae ae EF 

[tlUse of operator 1/D for integration generates some subtle mathematical difficulties because the operators D and 1/D do not 
commute. For instance, we know that D(1/D) = 1 because 


i 
1 
(r)dt =—yit 1.53 
[ voar Dp” ( ) 


ae 


However, (1/D)D is not necessarily unity. Use of Cramer's rule in solving simultaneous integro-differential equations will always result in 
cancellation of operators 1/D and D. This procedure may yield erroneous results when the factor D occurs in the numerator as well as 
in the denominator. This happens, for instance, in circuits with all-inductor loops or all-capacitor cut sets. To eliminate this problem, 
avoid the integral operation in system equations so that the resulting equations are differential rather than integro-differential. In 
electrical circuits, this can be done by using charge (instead of current) variables in loops containing capacitors and choosing current 
variables for loops without capacitors. In the literature this problem of commutativity of D and 1/D is largely ignored. As mentioned 
earlier, such procedure gives erroneous results only in special systems, such as the circuits with all-inductor loops or all-capacitor cut 
sets. Fortunately such systems constitute a very small fraction of the systems we deal with. For further discussion of this topic and a 
correct method of handling problems involving integrals, see Ref. 4. 


1.9 INTERNAL AND EXTERNAL DESCRIPTION OF A SYSTEM 


The input-output relationship of a system is an external description of that system. We have found an external description (not the 
internal description) of systems in all the examples discussed so far. This may puzzle the reader because in each of these cases, we 
derived the input-output relationship by analyzing the internal structure of that system. Why is this not an internal description? What 
makes a description internal? Although it is true that we did find the input-output description by internal analysis of the system, we did 
so strictly for convenience. We could have obtained the input-output description by making observations at the external (input and 
output) terminals, for example, by measuring the output for certain inputs such as an impulse or a sinusoid. A description that be 
obtained from measurements at the external terminals (even when the rest of the system is sealed inside an inaccessible black box) is 
an external description. Clearly, the input-output description is an external description. What, then, is an internal description? Internal 


description is capable of providing the complete information about all possible signals in the system. An external description may not 
give such complete information. An external description can always be found from an internal description, but the converse is not 
necessarily true. We shall now give an example to clarify the distinction between an external and an internal description. 


Let the circuit in Fig. 1.41a with the input x(t) and the output y(t) be enclosed inside a "black box" with only the input and the output 
terminals accessible. To determine its external description, let us apply a known voltage x(t) at the input terminals and measure the 
resulting output voltage y(t). 


a 


system that cannot be described by external measurements. 


Figure 1.41: A 


Let us also assume that there is some initial charge Q, present on the capacitor. The output voltage will generally depend on both, the 
input x(t) and the initial charge Q,. To compute the output resulting because of the charge Qy, assume the input x(t) = O (short across 
the input). 


In this case, the currents in the two 2 © resistors in the upper and the lower branches at the output terminals are equal and opposite 
because of the balanced nature of the circuit. Clearly, the capacitor charge results in zero voltage at the outpu.!T] 


Now, to compute the output y(t) resulting from the input voltage x(t), we assume zero initial capacitor charge (short across the capacitor 
terminals). The current i(t) (Fig. 1.41a), in this case, divides equally between the two parallel branches because the circuit is balanced. 
Thus, the voltage across the capacitor continues to remain zero. Therefore, for the purpose of computing the current i(f), the capacitor 
may be removed or replaced by a short. The resulting circuit is equivalent to that shown in Fig. 1.41b, which shows that the input x(t) 
sees a load of 5 O, and 


i(t) = dx(t) 


Also, because y(t) = 2i(t), 


y(t) = 2x(t) (1.78) 


This is the total response. Clearly, for the external description, the capacitor does not exist. No external measurement or external 
observation can detect the presence of the capacitor. Furthermore, if the circuit is enclosed inside a "black box" so that only the 
external terminals are accessible, it is impossible to determine the currents (or voltages) inside the circuit from external measurements 
or observations. An internal description, however, can provide every possible signal inside the system. In Example 1.15, we shall find 
the internal description of this system and show that it is capable of determining every possible signal in the system. 


For most systems, the external and internal descriptions are equivalent, but there are a few exceptions, as in the present case, where 
the external description gives an inadequate picture of the systems. This happens when the system is uncontrollable and/or 
unobservable. 


Figure 1.42 shows structural representations of simple uncontrollable and unobservable systems. In Fig. 1.42a, we note that part of the 
system (subsystem S>2) inside the box cannot be controlled by the input x(t). In Fig. 1.42b, some of the system outputs (those in 
subsystem S») cannot be observed from the output terminals. If we try to describe either of these systems by applying an external input 
x(t) and then measuring the output y(t), the measurement will not characterize the complete system but only the part of the system 
(here S1) that is both controllable and observable (linked to both the input and output). Such systems are undesirable in practice and 
should be avoided in any system design. The system in Fig. 1.41a can be shown to be neither controllable nor observable. It can be 
represented structurally as a combination of the systems in Fig. 1.42a and 1.42b. 


Figure 1.42: Structures of uncontrollable and unobservable systems. 


[tlThe output voltage y(t) resulting because of the capacitor charge [assuming x(t) = O] is the zero-input response, which, as argued 
above, is zero. The output component due to the input x(t) (assuming zero initial capacitor charge) is the zero-state response. 
Complete analysis of this problem is given later in Example 1.15. 


1.10 INTERNAL DESCRIPTION: THE STATE-SPACE DESCRIPTION 


We shall now introduce the state-space description of a linear system, which is an internal description of a system. In this approach, we 
identify certain key variables, called the state variables, of the system. These variables have the property that every possible signal in 
the system can be expressed as a linear combination of these state variables. For example, we can show that every possible signal in a 
passive RLC circuit can be expressed as a linear combination of independent capacitor voltages and inductor currents, which, therefore, 
are state variables for the circuit. 


To illustrate this point, consider the network in Fig. 1.43. We identify two state variables; the capacitor voltage q1 and the inductor 
current qo. If the values of q1, gz, and the input x(t) are known at some instant ft, we can demonstrate that every possible signal 
(current or voltage) in the circuit can be determined at ¢. For example, if gq; = 10, ga = 1, and the input x = 20 at some instant, the 
remaining voltages and currents at that instant will be 


i, = (x -—q,)/1 =20—-—10=10A 
vy =x —-q =20-10=10V 

v3 =q, = 10V 

i=qi/2=5A 


(1.79) 
ic =i, ~i,-—GQ2 =10-5-1=4A 
i; =@=I1A 
v3 = 5q.=5V 


vp =Q) —¥3=10-S=5V 


Thus all signals in this circuit are determined. Clearly, state variables consist of the key variables in a system; a knowledge of the state 
variables allows one to determine every possible output of the system. Note that the state-variable description is an internal description 
of a system because it is capable of describing all possible signals in the system. 


itt) iO 


x(t) 300) 


Figure 1.43: Choosing suitable initial conditions in a network. 


EXAMPLE 1.14 


This example illustrates how state equations may be natural and easier to determine than other descriptions, such as loop or node 
equations. Consider again the network in Fig. 1.43 with q; and qo as the state variables and write the state equations. 


This can be done by simple inspection of Fig. 1.43. Since dis the current through the capacitor, 
gi = te = h —12—- G2 


= (x -—qi) -0.5q1 — qQ2 
=-1541-—q.+x 


Also 242, the voltage across the inductor, is given by 
242 = qi — U3 


= 4 — 542 


or 


Go = 0.5q, —2.5q2 


Thus the state equations are 


5 = 1591 -—gotx 
. (1.80) 
G2 =05q -—2.5q2 


This is a set of two simultaneous first-order differential equations. This set of equations is known as the state equations. Once these 
equations have been solved for q4 and qo, everything else in the circuit can be determined by using Eqs. (1.79). The set of output 
equations (1.79) is called the output equations. Thus, in this approach, we have two sets of equations, the state equations and the 
output equations. Once we have solved the state equations, all possible outputs can be obtained from the output equations. In the 
input-output description, an Nth-order system is described by an Nth-order equation. In the state-variable approach, the same system 


is described by N simultaneous first-order state equations.!T] 


EXAMPLE 1.15 

In this example, we investigate the nature of state equations and the issue of controllability and observability for the circuit in Fig. 1.41a. 
This circuit has only one capacitor and no inductors. Hence, there is only one state variable, the capacitor voltage q(t). Since C = 1 F, 
the capacitor current is q. There are two sources in this circuit: the input x(t) and the capacitor voltage q(t). The response due to x(t), 
assuming q(t) = 0, is the zero-state response, which can be found from Fig. 1.44a, where we have shorted the capacitor [q(t) = 0]. The 
response due to q(t) assuming x(t) = 0, is the zero-input response, which can be found from Fig. 1.44b, where we have shorted x(t) to 
ensure x(f) = 0. It is now trivial to find both the components. 


Figure 1.44a shows zero-state currents in every branch. It is clear that the input x(t) sees an effective resistance of 5 Q, and, hence, 
the current through x(t) is x/5 A, which divides in the two parallel branches resulting in the current x/10 through each branch. 


ib) 


Figure 1.44: Analysis of a system that is neither controllable nor observable. 


Examining the circuit in Fig. 1.44b for the zero-input response, we note that the capacitor voltage is q and the current is g. We also 
observe that the capacitor sees two loops in parallel, each with resistance 4 O and current q/2. Interestingly, the 3 QO branch is 
effectively shorted because the circuit is balanced, and thus the voltage across the terminals cd is zero. The total current in any branch 
is the sum of the currents in that branch in Fig. 1.44a and 1.44b (principle of superposition). 


Branch Current Voltage 


ca ~ +4 o(= +f) 

o st G-4) 

” G72 (7-4) (1.81) 
bd ee o(= +4) 

ec _ a(z 

ed : x 


To find the state equation, we note that the current in branch ca is (x/10) + q/2 and the current in branch cb is (x/10) — q/2. Hence, the 
equation around the loop acba is 


q = —0.5q (1.82) 
This is the desired state equation. 


Substitution of q = —0.5q in Eqs. (1.81) shows that every possible current and voltage in the circuit can be expressed in terms of the 
state variable q and the input x, as desired. Hence, the set of Eqs. (1.81) is the output equation for this circuit. Once we have solved 
the state equation (1.82) for g, we can determine every possible output in the circuit. 


The output y(t) is given by 


x 4g x G 
#0) =2|—.-— 2] 42/42 
10 2 10 2 
2 
= =x(t) (1.83 
5 ) 
A little examination of the state and the output equations indicates the nature of this system. The state equation (1.82) shows that the 
state q(t) is independent of the input x(t), and hence, the system state q cannot be controlled by the input. Moreover, Eq. (1.83) shows 
that the output y(t) does not depend on the state q(t). Thus, the system state cannot be observed from the output terminals. Hence, 
the system is neither controllable nor observable. Such is not the case of other systems examined earlier. Consider, for example, the 
circuit in Fig. 1.43. The state equation (1.80) shows that the states are influenced by the input directly or indirectly. Hence, the system 
is controllable. Moreover, as the output Eqs. (1.79) show, every possible output is expressed in terms of the state variables and the 
input. Hence, the states are also observable. 


State-space techniques are useful not just because of their ability to provide internal system description, but for several other reasons, 
including the following. 


1. State equations of a system provide a mathematical model of great generality that can describe not just linear systems, 
but also nonlinear systems; not just time-invariant systems, but also time-varying parameter systems; not just SISO 
(single-input/single-output) systems, but also multiple-input/multiple-output (MIMO) systems. Indeed, state equations are 
ideally suited for the analysis, synthesis, and optimization of MIMO systems. 


2. Compact matrix notation and the powerful techniques of linear algebra greatly facilitates complex manipulations. Without 
such features, many important results of the modern system theory would have been difficult to obtain. State equations 
can yield a great deal of information about a system even when they are not solved explicitly. 


3. State equations lend themselves readily to digital computer simulation of complex systems of high order, with or without 
nonlinearities, and with multiple inputs and outputs. 


4. For second-order systems (N = 2), a graphical method called phase-plane analysis can be used on state equations, 
whether they are linear or nonlinear. 


The real benefits of the state-space approach, however, are realized for highly complex systems of large order. Much of the book is 
devoted to introduction of the basic concepts of linear systems analysis, which must necessarily begin with simpler systems without 
using the state-space approach. Chapter 10 deals with the state-space analysis of linear, time invariant, continuous-time, and discrete- 
time systems. 


EXERCISE E1.20 


Write the state equations for the series RLC circuit shown in Fig. 1.45, using the inductor current q; (t) and «> 
the capacitor voltage q2(t) as state variables. Express every voltage and current in this circuit as a linear 
combination of q1, gz, and x. 


a 
q\ (t) 
{ 
x(t) 
Figure 1.45 
Answers 
Gi = —3G1 —G2 +X 
qr 


Qi = —9 4) —G2t+x 
G2 = 2H 


[tlThis assumes the system to be controllable and observable. If it is not, the input-output description equation will be of an order lower 
than the corresponding number of state equations. 


1.11 SUMMARY 


A signal is a set of data or information. A system processes input signals to modify them or extract additional information from them to 
produce output signals (response). A system may be made up of physical components (hardware realization), or it may be an algorithm 
that computes an output signal from an input signal (software realization). 


A convenient measure of the size of a signal is its energy, if it is finite. If the signal energy is infinite, the appropriate measure is its 
power, if it exists. The signal power is the time average of its energy (averaged over the entire time interval from — oo to oo). For 
periodic signals the time averaging need be performed only over one period in view of the periodic repetition of the signal. Signal power 
is also equal to the mean squared value of the signal (averaged over the entire time interval from t = — oo to 0). 


Signals can be classified in several ways. 


1. A continuous-time signal is specified for a continuum of values of the independent variable (such as time ft). A discrete- 
time signal is specified only at a finite or a countable set of time instants. 


2. An analog signal is a signal whose amplitude can take on any value over a continuum. On the other hand, a signal whose 
amplitudes can take on only a finite number of values is a digital signal. The terms discrete-time and continuous-time 
qualify the nature of a signal along the time axis (horizontal axis). The terms analog and digital, on the other hand, qualify 
the nature of the signal amplitude (vertical axis). 


3. A periodic signal x(t) is defined by the fact that x(t) = x(t + Tp) for some Tg. The smallest value of Tg for which this 
relationship is satisfied is called the fundamental period. A periodic signal remains unchanged when shifted by an integer 
multiple of its period. A periodic signal x (t) can be generated by a periodic extension of any contiguous segment of x(t) of 
duration Tg. Finally, a periodic signal, by definition, must exist over the entire time interval — co < t< o. A signal is 


aperiodic if it is not periodic. 


An everlasting signal starts at tf = — oo and continues forever to f = oo. Hence, periodic signals are everlasting signals. A 
causal signal is a signal that is zero for t < 0. 


4. A signal with finite energy is an energy signal. Similarly a signal with a finite and nonzero power (mean square value) is a 
power signal. A signal can be either an energy signal or a power signal, but not both. However, there are signals that are 
neither energy nor power signals. 


5. A signal whose physical description is known completely in a mathematical or graphical form is a deterministic signal. A 


random signal is known only in terms of its probabilistic description such as mean value or mean-square value, rather than 
by its mathematical or graphical form. 


A signal x(t) delayed by T seconds (right-shifted) can be expressed as x(t — T); on the other hand, x(t) advanced by T (left-shifted) is x(t 
+ T). A signal x(t) time-compressed by a factor a (a > 1) is expressed as x/(at); on the other hand, the same signal time-expanded by 
factor a (a > 1) is x(V/a). The signal x(t) when time reversed can be expressed as x(—?). 


The unit step function u(t) is very useful in representing causal signals and signals with different mathematical descriptions over different 
intervals. 


In the classical (Dirac) definition, the unit impulse function 8(t) is characterized by unit area and is concentrated at a single instant t = 0. 
The impulse function has a sampling (or sifting) property, which states that the area under the product of a function with a unit impulse 
is equal to the value of that function at the instant at which the impulse is located (assuming the function to be continuous at the 
impulse location). In the modern approach, the impulse function is viewed as a generalized function and is defined by the sampling 
property. 


The exponential function eS where s is complex, encompasses a large class of signals that includes a constant, a monotonic 
exponential, a sinusoid, and an exponentially varying sinusoid. 


A real signal that is symmetrical about the vertical axis (tf = 0) is an even function of time, and a real signal that is antisymmetrical about 
the vertical axis is an odd function of time. The product of an even function and an odd function is an odd function. However, the 
product of an even function and an even function or an odd function and an odd function is an even function. The area under an odd 
function from t = —a to a is always zero regardless of the value of a. On the other hand, the area under an even function from t = —a 
to a is two times the area under the same function from ft = 0 to a (or from t = —a to 0). Every signal can be expressed as a sum of odd 
and even function of time. 


A system processes input signals to produce output signals (response). The input is the cause, and the output is its effect. In general, 
the output is affected by two causes: the internal conditions of the system (such as the initial conditions) and the external input. 


Systems can be classified in several ways. 


1. Linear systems are characterized by the linearity property, which implies superposition; if several causes (such as various 
inputs and initial conditions) are acting on a linear system, the total output (response) is the sum of the responses from 
each cause, assuming that all the remaining causes are absent. A system is nonlinear if superposition does not hold. 


2. In time-invariant systems, system parameters do not change with time. The parameters of time-varying-parameter 
systems change with time. 


3. For memoryless (or instantaneous) systems, the system response at any instant t depends only on the value of the input 
at t. For systems with memory (also known as dynamic systems), the system response at any instant t depends not only 
on the present value of the input, but also on the past values of the input (values before 2). 


4. In contrast, if a system response at tf also depends on the future values of the input (values of input beyond f), the system 
is noncausal. In causal systems, the response does not depend on the future values of the input. Because of the 
dependence of the response on the future values of input, the effect (response) of noncausal systems occurs before the 
cause. When the independent variable is time (temporal systems), the noncausal systems are prophetic systems, and 
therefore, unrealizable, although close approximation is possible with some time delay in the response. Noncausal 
systems with independent variables other than time (e.g., space) are realizable. 


5. Systems whose inputs and outputs are continuous-time signals are continuous-time systems; systems whose inputs and 
outputs are discrete-time signals are discrete-time systems. If a continuous-time signal is sampled, the resulting signal is a 
discrete-time signal. We can process a continuous-time signal by processing the samples of the signal with a discrete-time 
system. 


6. Systems whose inputs and outputs are analog signals are analog systems; those whose inputs and outputs are digital 
signals are digital systems. 


7. If we can obtain the input x(t) back from the output y(t) of a system S by some operation, the system S is said to be 
invertible. Otherwise the system is noninvertible. 


8. A system is stable if bounded input produces bounded output. This defines the external stability because it can be 
ascertained from measurements at the external terminals of the system. The external stability is also known as the stability 
in the BIBO (bounded-input/bounded-output) sense. The internal stability, discussed later in Chapter 2, is measured in 
terms of the internal behavior of the system. 


The system model derived from a knowledge of the internal structure of the system is its internal description. In contrast, an external 
description is a representation of a system as seen from its input and output terminals; it can be obtained by applying a known input 
and measuring the resulting output. In the majority of practical systems, an external description of a system so obtained is equivalent to 


its internal description. At times, however, the external description fails to describe the system adequately. Such is the case with the so- 
called uncontrollable or unobservable systems. 


A system may also be described in terms of certain set of key variables called state variables. In this description, an Nth-order system 
can be characterized by a set of N simultaneous first-order differential equations in N state variables. State equations of a system 
represent an internal description of that system. 
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MATLAB SESSION 1: WORKING WITH FUNCTIONS 


Working with functions is fundamental to signals and systems applications. MATLAB provides several methods of defining and 
evaluating functions. An understanding and proficient use of these methods is therefore necessary and beneficial. 


M1.1 Inline Functions 


Many simple functions are most conveniently represented by using MATLAB inline objects. An inline object provides a symbolic 
representation of a function defined in terms of MATLAB operators and functions. For example, consider defining the exponentially 


damped sinusoid f(t) = e~! cos(2tr?). 


>> f = inline('exp(-t).*cos(2*pi*t)','t') 
f = Inline function: 
f(t) = exp(-t).*cos(2*pi*t) 


The second argument to the inline command identifies the function's input argument as t. Input arguments, such as t, are local to 
the inline object and are not related to any workspace variables with the same names. 


Once defined, f(t) can be evaluated simply by passing the input values of interest. For example, 

>> t = 0; 

>> £(t) 

ans = 1 

evaluates f(t) at t = 0, confirming the expected result of unity. The same result is obtained by passing ¢ = 0 directly. 


>> £(0) 
ans = 1 


Vector inputs allow the evaluation of multiple values simultaneously. Consider the task of plotting f(t) over the interval (—2 < t < 2). 
Gross function behavior is clear: f(t) should oscillate four times with a decaying envelope. Since accurate hand sketches are 
cumbersome, MATLAB-generated plots are an attractive alternative. As the following example illustrates, care must be taken to ensure 
reliable results. 


Suppose vector t is chosen to include only the integers contained in (—2 < t < 2), namely [—2, —1, 0, 1, 2]. 
>> t = (-2:2); 


This vector input is evaluated to form a vector output. 


>> £(t) 
ans = 7.3891 2.7183 1.0000 0.3679 0.1353 


The plot command graphs the result, which is shown in Fig. M1.1. 


>> plot(t,f(t)); 
>> xlabel('t'); ylable('f(t)'); grid; 


fo 


Figure M1.1: f(t) = e' cos (2trft) fort = (-2:2). 


Grid lines, added by using the grid command, aid feature identification. Unfortunately, the plot does not illustrate the expected 
oscillatory behavior. More points are required to adequately represent f(t). 


The question, then, is how many points is enough?!T] If too few points are chosen, information is lost. If too many points are chosen, 


memory and time are wasted. A balance is needed. For oscillatory functions, plotting 20 to 200 points per oscillation is normally 
adequate. For the present case, t is chosen to give 100 points per oscillation. 


o> th = (-220..0122) 3 


Again, the function is evaluated and plotted. 


>> plot (t,f(t)); 
>> xlabel('t'); ylabel('f(t)'); grid; 


The result, shown in Fig. M1.2, is an accurate depiction of f(t). 
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Figure M1.2: f(t) = et cos(2trt) fort = (-2:0.01:2). 


M1.2 Relational Operators and the Unit Step Function 


The unit step function u(t) arises naturally in many practical situations. For example, a unit step can model the act of turning on a 
system. With the help of relational operators, inline objects can represent the unit step function. 


In MATLAB, a relational operator compares two items. If the comparison is true, a logical true (1) is returned. If the comparison is 
false, a logical false (0) is returned. Sometimes called indicator functions, relational operators indicates whether a condition is true. Six 
relational operators are available: <, >, <=, >=, , and ~=. 


The unit step function is readily defined using the >= relational operator. 
>> u = inline('(t>=0)','t") 

u = Inline function: 

u(t) = (t>=0) 


Any function with a jump discontinuity, such as the unit step, is difficult to plot. Consider plotting u(t) by using t = (-2:2). 


>> t = (-2:2); 


>> plot 


(t,u(t 


) 
>> xlable('t'); 


); 
ylabel ('u(t)'); 


Two significant problems are apparent in the resulting plot, shown in Fig. M1.3. First, MATLAB automatically scales plot axes to tightly 
bound the data. In this case, this normally desirable feature obscures most of the plot. Second, MATLAB connects plot data with lines, 
making a true jump discontinuity difficult to achieve. The coarse resolution of vector t emphasizes the effect by showing an erroneous 
sloping line between tf = — 1 andt — 0. 
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Figure M1.3: u(f) fort = (-2:2). 


The first problem is corrected by vertically enlarging the bounding box with the axis command. The second problem is reduced, but not 
eliminated, by adding points to vector t. 


>> t = (-2:0.01:2); 

>> plot (t,u(t)); 

>> xlable('t'); ylabel 
-0. 


el('u(t)'); 
>> axis ([-2 2 1. ke ) 


( 
1)); 

The four-element vector argument of axis specifies x-axis minimum, x-axis maximum, y-axis minimum, and y-axis maximum, 
respectively. The improved results are shown in Fig. M1.4. 


u(f) 
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Figure M1.4: u(f) fort = (-2:0.01:2) with axis modification. 


ho 


Relational operators can be combined using logical AND, logical OR, and logical negation: «, |, and ~, respectively. For example, 
(t>0) &(t<1) and ~((t<=0) | (t>=1)) both test if 0 < t< 1. To demonstrate, consider defining and plotting the unit pulse p(t) = 
u(t) — u(t — 1), as shown in Fig. M1.5: 


>> p = inline('(t>=0) & (t<1)','t'); 
>> t = (-1:0.01:2); plot(t,p(t)); 
>> xlabel('t'); ylabel('p(t) = u(t)-u(t-1)"'); 


>> axis ([-1 2 -.1 1.1]); 
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Figure M1.5: p(t) = u(t) — u(t — 1) over (-1 <t< 2). 


rm 


For scalar operands, MATLAB also supports two short-circuit logical constructs. A short-circuit logical AND is performed by using «&, 
and a short-circuit logical OR is performed by using | |. Short-circuit logical operators are often more efficient than traditional logical 
operators because they test the second portion of the expression only when necessary. That is, when scalar expression A is found false 
in (A&&B), scalar expression B is not evaluated, since a false result is already guaranteed. Similarly, scalar expression B is not 
evaluated when scalar expression A is found true in (A |B), since a true result is already guaranteed. 


M1.3 Visualizing Operations on the Independent Variable 


Two operations on a function's independent variable are commonly encountered: shifting and scaling. Inline objects are well suited to 
investigate both operations. 


Consider g(t) = f(t)u(t) = et cos(2Trf)u(t) a realizable version of f(t).{1) Unfortunately, MATLAB cannot multiply inline objects. That is, 
MATLAB reports an error for g = £*u when f and u are inline objects. Rather, g(t) needs to be explicitly defined. 


>> g = inline('exp(-t) .*cos(2*pi*t) .*(t>=0)', 't") 
g = Inline function: 
g(t) = exp(-t).*cos(2*pi*t) .* (t>=0) 


A combined shifting and scaling operation is represented by g(at + b), where a and b are arbitrary real constants. As an example, 
consider plotting g(2t + 1) over (—2 < t < 2). With a = 2, the function is compressed by a factor of 2, resulting in twice the oscillations 
per unit tf. Adding the condition b > 0, the waveform shifts to the left. Given inline function g, an accurate plot is nearly trivial to obtain. 
>> t = (-2:0.01:2); 

>> plot(t,g(2*tt+1)); xlabel('t'); ylabel('g(2t+1)')'; grid; 


Figure M1.6 confirms the expected waveform compression and left shift. As a final check, realize that function g(-) turns on when the 
input argument is zero. Therefore, g(2¢ + 1) should turn on when 2t + 1 = 0 or at tf = —0.5, a fact again confirmed by Fig. M1.6. 


g(2t+1) 
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Figure M1.6: 9(2f+ 1) over (—2 <t < 2). 


Next, consider plotting g(—f+ 1) over (—2 < ft < 2). Since a < 0, the waveform will be reflected. Adding the condition b > 0, the final 
waveform shifts to the right 
>> plot(t,g(-tt+1)); xlabel('t'); ylabel('g(-t+1)')'; grid; 


Figure M1.7 confirms both the reflection and the right shift. 
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Figure M1.7: g(—t+ 1) over (-2 <t< 2). 
Up to this point, Figs. M1.6 and M1.7 could be reasonably sketched by hand. Consider plotting the more complicated function h(t) = 
g(2t + 1) + g(—t + 1) over (—2 < ft < 2) (Fig. M1.8). In this case, an accurate hand sketch is quite difficult. With MATLAB, the work is 
much less burdensome. 
>> plot(t,g(2*t+1) +g(-tt+1)); xlabel('t'); ylabel('h(t)')'; grid; 


h(t) 
wo 


—0.6 


~0.8 : 
2s 108 0 6S £ 15 2 


Figure M1.8: h(t) = g(2t + 1) + g(—t + 1) over (-2 < t < 2). 


M1.4 Numerical Integration and Estimating Signal Energy 


Interesting signals often have nontrivial mathematical representations. Computing signal energy, which involves integrating the square of 
these expressions, can be a daunting task. Fortunately, many difficult integrals can be accurately estimated by means of numerical 
integration techniques. Even if the integration appears simple, numerical integration provides a good way to verify analytical results. 


To start, consider the simple signal x(t) = e~‘(u(t) — u(t — 1)). The energy of x(t) is expressed as Ey = J°_2 |x(t)|? dt = So et at. 
Integrating yields E, = 0.5(1 — e-?) = 0.4323. The energy integral can also be evaluated numerically. Figure 1.27 helps illustrate the 
simple method of rectangular approximation: evaluate the integrand at points uniformly separated by At, multiply each by At to compute 
rectangle areas, and then sum over all rectangles. First, we create function x(t). 

>> x = inline('exp(-t) .* ((t>=0) &(t<1))','t"); 


Letting At = 0.01, a suitable time vector is created. 
>> t = (0:0.01:1); 


The final result is computed by using the sum command. 
>> E x =sum(x(t).*x(t)*0.01) 


Ex = 0.4367 


The result is not perfect, but at 1% relative error it is close. By reducing Aft, the approximation is improved. For example, At = 0.001 
yields E_x = 0.4328, or 0.1% relative error. 


Although simple to visualize, rectangular approximation is not the best numerical integration technique. The MATLAB function quad 


implements a better numerical integration technique called recursive adaptive Simpson quadrature. !T] To operate, quad requires a 
function describing the integrand, the lower limit of integration, and the upper limit of integration. Notice, that no At needs to be 
specified. 


To use quad to estimate E,, the integrand must first be described. 
>> x squared = inline('exp(-2*t) .*((t>=0)&(t>1))','t"'); 


Estimating E, immediately follows. 


>> E x = quad(x squared, 0,1) 
E x = 0.4323 = 


In this case, the relative error is -0.0026%. 


The same techniques can be used to estimate the energy of more complex signals. Consider g(t), defined previously. Energy is 


~2t cos2 (2T1t) dt. A closed-form solution exists, but it takes some effort. MATLAB provides an answer more 


expressed as Ey = Jo e 
quickly. 


>> g_ squared = inline('exp(-2*t) .* (cos (2*pi*t) .**%2) .*(t>=0)', 't'); 


Although the upper limit of integration is infinity, the exponentially decaying envelope ensures g(t) is effectively zero well before t = 100. 
Thus, an upper limit of t= 100 is used along with At = 0.001. 
(0:0.001:100); 


>> Eg = sum(g_squared(t)*0.001) 
Eg = 0.2567 


A slightly better approximation is obtained with the quad function. 


>> E_g = quad(g_squared, 0,100) 
Eg = 0.2562 


As an exercise, confirm that the energy of signal h(t), defined previously, is E, = 0.3768. 
[tlsampling theory, presented later, formally addresses important aspects of this question. 
[tlThe function f(t) = et cos(2Trf) can never be realized in practice; it has infinite duration and, as tf — — 9, infinite magnitude. 


[tl comprehensive treatment of numerical integration is outside the scope of this text. Details of this particular method are not 
important for the current discussion; it is sufficient to say that it is better than the rectangular approximation. 


PROBLEMS 


1.1.1 Find the energies of the signals illustrated in Fig. P1.1-1. Comment on the effect on energy of sign change, time shifting, 
or doubling of the signal. What is the effect on the energy if the signal is multiplied by k? 


=a 


Figure P1.1-1 


1.1.2 Repeat Prob. 1.1-1 for the signals in Fig. P1.1-2. 
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Figure P1.1-2 


a. Find the energies of the pair of signals x(t) and y(t) depicted in Fig. P1.1-3a and P1.1-3b. Sketch and find 
the energies of signals x(t) + y(t) and x(t) — y(t). 


wr) 


{b) 


wi) 


(c) 


Figure P1.1-3 


Can you make any observation from these results? 
b. Repeat part (a) for the signal pair illustrated in Fig. P1.1-3c. Is your observation in part (a) still valid? 
1.1.4 Find the power of the periodic signal x(t) shown in Fig. P1.1-4. Find also the powers and the rms values of: 
a. —x(t) 
b. 2x(t) 


c. cx(t). 


A 


Figure P1.1-4 


Comment. 
1.1.5 Determine the power and the rms value for each of the following signals: 
a. 5 + 10 cos(100¢ + Tr/3) 
b. 10 cos(100¢ + 1/3) + 16sin(150¢ + Tr/5) 
c. (10 + 2sin 3t)cos 10¢ 
d. 10 cos5t cos 10t 
e. 10 sin 5t cos 10t 


f. ef cos wo! 


1.1.6 Figure P1.1-6 shows a periodic 50% duty cycle dc-offset sawtooth wave x(t) with peak amplitude A. Determine the 
energy and power of x(t). 


Figure P1.1-6: 50% duty cycle dc-offset sawtooth wave x(t). 


1.1.7 
a. There are many useful properties related to signal energy. Prove each of the following statements. In each 
case, let energy signal x4 (t) have energy E|x9 (t)], let energy signal x2(t) have energy E[x2(t)], and let T be 
a nonzero, finite, real-valued constant. 
i. Prove E[Tx,(t)] = TPE[x, (t)]. That is, amplitude scaling a signal by constant 7 scales the 
signal energy by FP. 
ii. Prove E[x,(t)] = E[x, (t — T)]. That is, shifting a signal does not affect its energy. 
iii. If (x4(t) # 0) > x(t) = 0) and (x9(t) # 0) > (x4(f) = 0), then prove Efx,(t) + xo(t)] = Efx,(t)] 
+ E[xo(t)]. That is, the energy of the sum of two nonoverlapping signals is the sum of the two 
individual energies. 
iv. Prove E[x,(Tt)] = (1/|T|)E[x4(é)]. That is, time-scaling a signal by T reciprocally scales the 
signal energy by 1/|7|. 
b. Consider the signal x(t) shown in Fig. P1.1-7. Outside the interval shown, x(t) is zero. Determine the signal 
energy E/[x(t)]. 
a5 
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Figure P1.1-7: Energy signal x(t). 
1.1.8 


a. Show that the power of a signal 
n 


x(t) = >. Dei is P, = 3 |D,P? 


k=m kom 


assuming all frequencies to be distinct, that is, w; # Wy, for all i + k. 
b. Using the result in part (a) determine the power of each of the signals in Prob. 1.1-5. 


1.1.9. A binary signal x(t) = 0 for t < 0. For positive time, x(t) toggles between one and zero as follows: one for 1 second, zero 
for 1 second, one for 1 second, zero for 2 seconds, one for 1 second, zero for 3 seconds, and so forth. That is, the "on" 
time is always one second but the "off" time successively increases by one second between each toggle. A portion of x(t) 
is shown in Fig. P1.1-9. Determine the energy and power of x(t). 


Figure P1.1-9: Binary signal x(t). 
1.2.1 For the signal x(t) depicted in Fig. P1.2-1, sketch the signals 


Figure P1.2-1 


1.2.2 For the signal x/(¢) illustrated in Fig. P1.2-2, sketch 
a. x(t-4) 
b. x(t/1.5) 
c. x(—f) 
d. x(2t — 4) 
e. x(2 — ft) 


= 


Figure P1.2-2 


1.2.3 In Fig. P1.2-3, express signals x4(t), x3(t) x3(t), x4(f), and xs5(f) in terms of signal x(t) and its time-shifted, time-scaled, or 
time-reversed versions. 


Figure P1.2-3 


1.2.4 Foran energy signal x(t) with energy E,, show that the energy of any one of the signals — x(t), x(—t), and x(t — T) is Ey. 


Show also that the energy of x(at) as well as x(at — b) is E,/a, but the energy of ax(t) is a*Ey. This shows that time 
inversion and time shifting do not affect signal energy. On the other hand, time compression of a signal (a > 1) reduces 
the energy, and time expansion of a signal (a < 1) increases the energy. What is the effect on signal energy if the signal 
is multiplied by a constant a? 


1.2.5 Define 2x(—3t+1) = t(u(—t—1)—u(—t+1)), where u(t) is the unit step function. 
a. Plot 2x(—3t+ 1) over a suitable range of t. 


b. Plot x(t) over a suitable range of ft. 


1.2.6 Consider the signal x(t) = 2-4) where u(t) is the unit step function. 


1.3.1 


1.3.2 


1.3.3 


1.3.4 
1.3.5 


a. Accurately sketch x(t) over (—1 <t < 1). 
b. Accurately sketch y(t) = 0.5x(1 — 2t) over (—-1 <t< 1). 


Determine whether each of the following statements is true or false. If the statement is false, demonstrate this by proof 
or example. 


a. Every continuous-time signal is analog signal. 

b. Every discrete-time signal is digital signal. 

c. If a signal is not an energy signal, then it must be a power signal and vice versa. 
d. An energy signal must be of finite duration. 

e. A power signal cannot be causal. 

f. A periodic signal cannot be anticausal. 


Determine whether each of the following statements is true or false. If the statement is false, demonstrate by proof or 
example why the statement is false. 


a. Every bounded periodic signal is a power signal. 
b. Every bounded power signal is a periodic signal. 
c. If an energy signal x(t) has energy EF, then the energy of x(at) is F/a. Assume a is real and positive. 
d. If a power signal x(t) has power P, then the power of x(at) is P/a. Assume a is real and positive. 
Given x(t) = cos(t), xo(t) = sin(mf), and x3(t) = x4(t) + xo(t). 
a. Determine the fundamental periods 7; and To of signals x4(t) and x(t). 
b. Show that x3(f) is not periodic, which requires T3 = ky 74 = kaTo for some integers k, and ko. 
c. Determine the powers P,1, Py2, and P,3 of signals x4(t), xo(t), and x3(?). 
For any constant w, is the function f(t) = sin (wt) a periodic function of the independent variable ¢? Justify your answer. 


The signal shown in Fig. P1.3-5 is defined as 
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Figure P1.3-5: Energy signal x(t). 
The energy of x(t) is E = 1.0417. 
a. What is the energy of y;(t) = (4)x(2t)? 


b. A periodic signal y(t) is defined as 


. x(t) O0<t<4 
n= yo(t + 4) Vt 


What is the power of y(t)? 


c. What is the power of y3(t) = (4) y2(2t)? 


13.6 Let y4(t) = yo(t) = t? over 0 < t < 1. Notice, this statement does not require y4(t) = yo(t) for all ¢. 
a. Define y(t) as an even, periodic signal with period 7; = 2. Sketch y4(t) and determine its power. 


b. Design an odd, periodic signal y2(t) with period Tz = 3 and power equal to unity. Fully describe y(t) and 
sketch the signal over at least one full period. [Hint: There are an infinite number of possible solutions to 
this problem-you need to find only one of them!] 


c. We can create a complex-valued function y3(t) = y4(t) + jya(t). Determine whether this signal is periodic. If 
yes, determine the period 73. If no, justify why the signal is not periodic. 


d. Determine the power of y3(t) defined in part (c). The power of a complex-valued function z(t) is 


1 te 
P= jim ;/ z(r)z*(r)dr 


=0T J rp 
1.4.1 Sketch the following signal: 
a. u(t — 5) — u(t — 7) 
b. u(t — 5) — u(t — 7) 
c. [u(t — 1) — u(t — 2)] 
d. (t — 4)[u(t — 2) — u(t — 4)] 


1.4.2 Express each of the signals in Fig. P1.4-2 by a single expression valid for all f. 


4h 41 (ft) 


(a) 


(b) 


Figure P1.4-2 


1.4.3 Simplify the following expressions: 


sin f 5(t) 
a \@+2 


jot+2 
—— ila 
b. or " 


c. [ef cos(3t — 60°)]8(t) 


(SEA) sa» 


r+4 
( : ) a + 3) 
- oO) < 
e. \Jot+2 


(= ‘o) $10) 
f. @ 


[Hint: Use Eq. (1.23). For part (f) use L'Hdpital's rule.] 


a 


1.44 Evaluate the following integrals: 
a. [°08(T)x(t-T)dT 
b. f° ox(T)8(t—T)dT 
c. J? « &(t)e /”*at 
d. [°c &(2t—3)ttdt 
e. f°. & (t+ 3)ee™ ‘at 
f. f°. (8 +4) & (1-2) dt 


g. f° X (2-18 (3—fat 


OD 
/ e*- cos [E(x - 5)] 5 (x —3)dx 


=) 


1.4.5 
a. Find and sketch dx/dt for the signal x(t) shown in Fig. P1.2-2. 


b. Find and sketch d2x/df? for the signal x(t) depicted in Fig. P1.4-2a. 


1.4.6 Find and sketch {'_.. x(t) df for the signal x(t) illustrated in Fig. P1.4-6. 


1.4.7 


1.4.8 


1.4.9 


1.4.10 


1.5.1 


(b) 
Figure P1.4-6 


Using the generalized function definition of impulse [Eq. (1.24a)], show that 8(f) is an even function of tf. 


Using the generalized function definition of impulse [Eq. (1.24a)], show that 


d(at) = + say 
lal 


Show that 


oO 
/ 3(t)b(t) dt = —¢(0) 


=) 


where (t) and #1) are continuous at t = 0, and (ft) — 0 as t ~ too. This integral defines 5(!) as a generalized 
function. [Hint: Use integration by parts.] 


A sinusoid e® cos wt can be expressed as a sum of exponentials eS! and e® [Eq. (1.30c)] with complex frequencies s 
= 0+ jw and s = o — jw. Locate in the complex plane the frequencies of the following sinusoids: 


a. cos 3t 


b. e ! cos 3t 


2 


c. e2! cos 3t 


d. e 2! 
e.e 


f. 5 


Find and sketch the odd and the even components of the following: 
a. u(t) 
b. tu(t) 
c. sin Wol 
d. cos Wot 
e. COS (Wot + 8) 
f. sin Wotu(t) 


g. cos Wotu(t) 


1.5.2 
a. Determine even and odd components of the signal x(t) = e~2‘u(t). 


b. Show that the energy of x(t) is the sum of energies of its odd and even components found in part (a). 
c. Generalize the result in part (b) for any finite energy signal. 


1.5.3 
a. If X,(t) and x(t) are even and the odd components of a real signal x(t), then show that 


OS 
/ Xe(t)x,{t) dt =0 


oo 


b. Show that 
oO 


oo 
/ xa = [ x,(t) dt 


1.5.4 An aperiodic signal is defined as x(t) = sin (trt)u(t), where u(t) is the continuous-time step function. Is the odd portion of 
this signal, xo(t), periodic? Justify your answer. 


1.5.5 An aperiodic signal is defined as x(t) = cos (trf)u(t), where u(t) is the continuous-time step function. Is the even portion 
of this signal, x,(t), periodic? Justify your answer. 


1.5.6 Consider the signal x(t) shown in Fig. P1.5-6. 
a. Determine and carefully sketch v(t) = 3x(-(1/2)(t + 1). 
b. Determine the energy and power of v(t). 
c. Determine and carefully sketch the ever portion of v(t), Ve(t). 
d. Let a = 2 and b = 3, sketch v(at + b), v(at) + b, av(t + b), and av(t) + b. 
e. Let a = —3 and b = —2, sketch v(at + b), v(at) + b, av(t + b), and av(t) + b. 


Figure P1.5-6 Input x(f). 
Figure P1.5-6: Input x(t). 


1.5.7 Consider the signal y(t) = (_)x(—2t — 3) shown in Figure P1.5-7. 


a. Does y(t) have an odd portion, yo(t)? If so, determine and carefully sketch yo(t). Otherwise, explain why 
no odd portion exists. 


b. Determine and carefully sketch the original signal x(t). 


-] 9) 1 7 f 


Figure P1.5-7: y(t) = x(—2t — 3). 
1.5.8 Consider the signal -(1/2)x(—3tf+ 2) show in Fig. P1.5-8. 
a. Determine and carefully sketch the original signal x(t). 


b. Determine and carefully sketch the even portion of the original signal x(t). 


1.5.9 


1.5.10 


1.5.11 


1.5.12 


1.6.1 


1.6.2 


c. Determine and carefully sketch the odd portion of the original signal x(t). 


Figure P1.5-8: -1/2x(—3t+ 2). 


The conjugate symmetric (or Hermitian) portion of a signal is defined as w,,(t) = (w(t) + w*(—t))/2. Show that the real 
portion of w,,(f) is even and that the imaginary portion of w,,(f) is odd. 


The conjugate antisymmetric (or skew-Hermitian) portion of a signal is defined as we,(t) = (w(t) + w*(—f))/2. Show that 
the real portion of Wea(t) is even and that the imaginary portion of w¢s(t) is even. 


Figure P1.5-11 plots a complex signal w(t) in the complex plane over the time range (0 < t < 1). The time t= 0 
corresponds with the origin, while the time t = 1 corresponds with the point (2,1). 


a. In the complex plane, plot w(t) over (—1 < t < 1) if: 
i. w(t) is an even signal. 
ii. w(t) is an odd signal. 
iii. w(t) is a conjugate symmetric signal. 
[Hint: See Prob. 1.5-9.] 
iv. w(t) is a conjugate antisymmetric signal. [Hint: See Prob. 1.5-10.] 


b. In the complex plane, plot as much of w(3t) as possible. 
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Figure P1.5-11: w(t) for (0 < t < 1). 


Define complex signal x(t) = t2(1 + j) over interval (1 < t < 2). The remaining portion is defined such that x(t) is a 
minimum-energy, skew-Hermitian signal. 


a. Fully describe x(t) for all ¢. 

b. Sketch y(t) = Re{x(i)}} versus the independent variable t. 

c. Sketch z(t) = Ref{jx(—2t + 1)} versus the independent variable t. 
d. Determine the energy and power of x(t). 


Write the input-output relationship for an ideal integrator. Determine the zero-input and zero-state components of the 
response. 


A force x(t) acts on a ball of mass M (Fig. P1.6-2). Show that the velocity v(é) of the ball at any instant t > 0 can be 
determined if we know the force x(t) over the interval from 0 to t and the ball's initial velocity v(0). 


Figure P1.6-2 


1.7.1 For the systems described by the following equations, with the input x(t) and output y(t), determine which of the 
systems are linear and which are nonlinear. 


dy 

— Iv(r) = x 

= + 2y(t) = x°(D 
dy > 

a + 3ty(t) = x(t) 


c. 3 y(t) +2 = x(t) 


yy t)=x(t 
dat? 0) = 2G) 
dy ; 
— 2y(t) =: 
_[Zi) #90=H0 
dy P _ dx 
i ae + (sin fy(t) = ae + 2x(t) 
dy dx 
— oy = wis 
q. dt + 2y(t) 2s. 


he Wih= faxed t 


1.7.2 For the systems described by the following equations, with the input x(t) and output y(t), explain with reasons which of 
the systems are time-invariant parameter systems and which are time-varying-parameter systems. 


a. y(t) = x(t — 2) 
b. y(t) = x(-t) 
c. y(t) = x(at) 
d. y(t) = tx(t-2) 


e. y(t) = 0 °_5x(T)dT 


(= dx ' 
,? ro dt 


1.7.3 For a certain LTI system with the input x(é), the output y(t) and the two initial conditions q4(0) and q2(0), following 
observations were made: 


= Open table as spreadsheet 


x(t) || q1(0) |} q2(0) || yi 

0 1 —1 etu(t) 

0 2 1 et(3t + 2)u(t) 
ee ee ee ee 


1.74 


1.7.5 


1.7.6 


1.7.7 


1.7.8 


[ut) ||-1 = 2u(t) 


Determine y(t) when both the initial conditions are zero and the input x(t) is as shown in Fig. P1.7-3. [Hint: There are 
three causes: the input and each of the two initial conditions. Because of the linearity property, if a cause is increased 
by a factor k, the response to that cause also increases by the same factor k. Moreover, if causes are added, the 
corresponding responses add.] 


x(t) 


5 5 t-> 
Figure P1.7-3 
A system is specified by its input-output relationship as 
(1) 
y(t) = ——— 
: dx/dt 


Show that the system satisfies the homogeneity property but not the additivity property. 


Show that the circuit in Fig. P1.7-5 is zero-state linear but not zero-input linear. Assume all diodes to have identical 
(matched) characteristics. The output is the current y(t). 


vir) 


x(t) 


Figure P1.7-5 


The inductor L and the capacitor C in Fig. P1.7-6 are nonlinear, which makes the circuit nonlinear. The remaining three 
elements are linear. Show that the output y(f) of this nonlinear circuit satisfies the linearity conditions with respect to the 
input x(t) and the initial conditions (all the initial inductor currents and capacitor voltages). 


Figure P1.7-6 


For the systems described by the following equations, with the input x(t) and output y(t), determine which are causal 
and which are noncausal. 


- Y(t) = x(t — 2) 
b. y(t) = x(- f) 
c. y(t) = x(at)a> 1 


» 


d. y(t) = x(at)a<1 


For the systems described by the following equations, with the input x(t) and output y(t), determine which are invertible 
and which are noninvertible. For the invertible systems, find the input-output relationship of the inverse system. 


a. y(t) = ft. x(T) dT 
b. y(t) = x" (t) x(t) real and rn integer 


dx(t) 
c: Wh) = dt 


d. y(t) = x (3t-6) 
e. y(t) = cos [x(t] 
f. y(t)= e * x(t) real 
1.7.9 Consider a system that multiplies a given input by a ramp function, r(t) = tu(t). That is, y(t) = x(r(t). 
a. Is the system linear? Justify your answer. 
b. Is the system memoryless? Justify your answer. 
c. Is the system causal? Justify your answer. 
d. Is the system time invariant? Justify your answer. 
1.7.10 A ae gl system is given by 


yn =o5 | x(r [S(t — +t) — (t+ 4r)] dr 


~*) 


Recall that 5(t) designates the Dirac delta function. 
a. Explain what this system does. 
b. Is the system BIBO stable? Justify your answer. 
c. Is the system linear? Justify your answer. 
d. Is the system memoryless? Justify your answer. 
e. Is the system causal? Justify your answer. 
f. Is the system time invariant? Justify your answer. 
1.7.11. A system is given by 
é 
y(t) = ae —1) 
a. Is the system BIBO stable? [Hint: Let system input x(t) be a square wave.] 
b. Is the system linear? Justify your answer. 
c. Is the system memoryless? Justify your answer. 
d. Is the system causal? Justify your answer. 
e. Is the system time invariant? Justify your answer. 


1.7.12 A system is given by 
x(t) if x(t)>0 
y(t) = 


0 if x(t) <0 
a. Is the system BIBO stable? Justify your answer. 
b. Is the system linear? Justify your answer. 
c. Is the system memoryless? Justify your answer. 
d. Is the system causal? Justify your answer. 


e. Is the system time invariant? Justify your answer. 


1.7.13 Figure P1.7-13 displays an input x4(f) to a linear time-invariant (LTI|) system H, the corresponding output y;(f), and a 


second input x9(f). 


a. Bill suggests that x(t) = 2x4(3t) — x4(t — 1). Is Bill correct? If yes, prove it. If not, correct his error. 


b. Hoping to impress Bill, Sue wants to know the output y2(t) in response to the input x9(t). Provide her with 
an expression for yo(t) in terms of y(t). Use MATLAB to plot yo(t). 


H 
Figure P1.7-13; *!() —> Yi and xo(t). 
1.8.1 


For the circuit depicted in Fig. P1.8-1, find the differential equations relating outputs y;(f) and yo(t) to the input x(t). 


30 


x(t) 


Figure P1.8-1 


1.8.2 Repeat Prob. 1.8-1 for the circuit in Fig. P1.8-2. 


Figure P1.8-2 
1.8.3. A simplified (one-dimensional) model of an automobile suspension system is shown in Fig. P1.8-3. In this case, the input 
is not a force but a displacement x(t) (the road contour). Find the differential equation relating the output y(t) (auto body 
displacement) to the input x(t) (the road contour). 
y (Auto body elevation) 
x (Road elevation) 
Figure P1.8-3 
1.8.4 


A field-controlled dc motor is shown in Fig. P1.8-4. Its armature current iz is maintained constant. The torque generated 
by this motor is proportional to the field current j; (torque = Kyif). Find the differential equation relating the output position 
6 to the input voltage x(t). The motor and load together have a moment of inertia J. 


te constant 


x(t) 


Figure P1.8-4 


1.8.5 Water flows into a tank at a rate of q; units/s and flows out through the outflow valve at a rate of qq units/s (Fig. P1.8-5). 
Determine the equation relating the outflow go to the input q;. The outflow rate is proportional to the head h. Thus qo = 
Rh, where R is the valve resistance. Determine also the differential equation relating the head h to the input q;. [Hint: The 
net inflow of water in time At is (qj; — qg)At. This inflow is also AAh where A is the cross section of the tank.] 


qi - > Yo 
Figure P1.8-5 


1.8.6 Consider the circuit shown in Fig. P1.8-6, with input voltage x(t) and output currents y4(t), yo(t), and y3(f). 
a. What is the order of this system? Explain your answer. 
b. Determine the matrix representation for this system. 


c. Use Cramer's rule to determine the output current y3(t) for the input voltage x(t) = (2 — | cos(t)|)u(t — 1). 


xp ae 


Figure P1.8-6: Resistor circuit. 


R,=1 R,=3 R;=5 


1.10.1 Write state equations for the parallel RLC circuit in Fig. P1.8-2. Use the capacitor voltage q; and the inductor current 


qdz as your state variables. Show that every possible current or voltage in the circuit can be expressed in terms of qj, 
qz2 and the input x(t) 


1.10.2 Write state equations for the third-order circuit shown in Fig. P1.10-2, using the inductor currents q1, qz2 and the 
capacitor voltage q3 as state variables. Show that every possible voltage or current in this circuit can be expressed as a 
linear combination of q1, 92, q3, and the input x(t). Also, at some instant ¢ it was found that q1 = 5, qo = 1, q3 = 2, and 
xX = 10. Determine the voltage across and the current through every element in this circuit. 


q| 1H q2 3 


1Q 


Figure P1.10-2 


Chapter 2: Time-Domain Analysis of Continuous-Time Systems 


In this book we consider two methods of analysis of linear time-invariant (LTI) systems: the time-domain method and the frequency-domain method. 
In this chapter we discuss the time-domain analysis of linear, time-invariant, continuous-time (LTIC) systems. 


2.1 INTRODUCTION 


For the purpose of analysis, we shall consider linear differential systems. This is the class of LTIC systems introduced in Chapter 1, for which the 
input x(t) and the output y(t) are related by linear differential equations of the form 


a +a a? LF +4 A + dy y(t) 
— + a; —— +--+ + ay; + ayy 
di® *" di¥-) inte ei 
d™ d¥-'x dx 
= by_w am DN-M+ +++. + bv-1 5° + byx(t) (2, 1a) 


where all the coefficients a; and b; are constants. Using operational notation D to represent d/dt, we can express this equation as 


(D* + a,D*"! +--- + ay_1D +ay)y(t) 


= (byw D™ + bys DM +--+ + by 1D + by) x(0) (2.1b) 
or 
O(D)y(t) = P(D)x(t) (2.1) 
where the polynomials Q(D) and P(D) are 
Q(D) = D® +a,D*"!+---+av 1D +aw (2.2a) 
P(D) = byw DM + by aiD™' +--+ by 1D + by (2.2b) 


Theoretically the powers M and N in the foregoing equations can take on any value. However, practical considerations make M > N undesirable for 
two reasons. In Section 4.3-2, we shall show that an LTIC system specified by Eq. (2.1) acts as an (M — N)th-order differentiator. 


A differentiator represents an unstable system because a bounded input like the step input results in an unbounded output, 5 (t). Second, the noise 
is enhanced by a differentiator. Noise is a wideband signal containing components of all frequencies from O to a very high frequency approaching 


colt], Hence, noise contains a significant amount of rapidly varying components. We know that the derivative of any rapidly varying signal is high. 
Therefore, any system specified by Eq. (2.1) in which M > N will magnify the high-frequency components of noise through differentiation. It is entirely 
possible for noise to be magnified so much that it swamps the desired system output even if the noise signal at the system's input is tolerably small. 
Hence, practical systems generally use M < N. For the rest of this text we assume implicitly that M < N. For the sake of generality, we shall assume 
M = N in Eq. (2.1). 


In Chapter 1, we demonstrated that a system described by Eq. (2.1) is linear. Therefore, its response can be expressed as the sum of two 
components: the zero-input component and the zero-state component (decomposition property).!+1 Therefore, 
total response = zero-input response + zero-state response (2.3) 


The zero-input component is the system response when the input x(t) = 0, and thus it is the result of internal system conditions (such as energy 
storages, initial conditions) alone. It is independent of the external input x(t). In contrast, the zero-state component is the system response to the 
external input x(t) when the system is in zero state, meaning the absence of all internal energy storages: that is, all initial conditions are zero. 


[TINoise is any undesirable signal, natural or man-made, that interferes with the desired signals in the system. Some of the sources of noise are the 
electromagnetic radiation from stars, the random motion of electrons in system components, interference from nearby radio and television stations, 
transients produced by automobile ignition systems, and fluorescent lighting. 


[t]we can verify readily that the system described by Eq. (2.1) has the decomposition property. If yo(t) is the zero-input response, then, by definition, 
Q(D)yo(t) = 0 


If y(t) is the zero-state response, then y(t) is the solution of 
Q(D) y(t) = P(D)x(t) 


subject to zero initial conditions (zero-state). Adding these two equations, we have 
Q(D)Lyo(t) + y(t] = P(D)x(t) 


Clearly, yo(t)t+y(t) is the general solution of Eq. (2.1). 


2.2 SYSTEM RESPONSE TO INTERNAL CONDITIONS: THE ZERO-INPUT RESPONSE 


The zero-input response yo(t) is the solution of Eq. (2.1) when the input x(t) = 0 so that 


O(D)yo(t) = 0 (2.4a) 


or 


(D* + a,D* ae ee + ay_,D + an)yolt) = 0 (2.4b) 


A solution to this equation can be obtained systematically.) However, we will take a shortcut by using heuristic reasoning. Equation (2.4b) shows 
that a linear combination of yo(t) and its N successive derivatives is zero, not at some values of t, but for all t. Such a result is possible if and only if 


yo(t) and all its N successive derivatives are of the same form. Otherwise their sum can never add to zero for all values of t. We know that only an 


exponential function e* has this property. So let us assume that 


yo(t) = ce” 

is a solution to Eq. (2.4b). Then 
dyo 

Dyo(t) — ry — che™ 
. d’y ' 

D*yo(t) = “a = che 
dt 
d® y¢ = 

D* yo(t) = ae = ca e™ 


Substituting these results in Eq. (2.4b), we obtain 
c(AN + aay +--+ anid tayye" =0 
For a nontrivial solution of this equation, 
AN 4a aN! +---+ayiid+an =0 (2.5a) 


This result means that ce! is indeed a solution of Eq. (2.4), provided \ satisfies Eq. (2.5a). Note that the polynomial in Eq. (2.5a) is identical to the 
polynomial Q(D) in Eq. (2.4), with A replacing D. Therefore, Eq. (2.5a) can be expressed as 


O(A) =0 (2.5b) 
When Q (A) is expressed in factorized form, Eq. (2.5b) can be represented as 
QO(A) = (A — Ay) (A — da) + (A — Aw) =0 (2.5¢) 


Clearly, \ has N solutions: A4, Az,.-., Ay, assuming that all A;, are distinct. Consequently, Eq. (2.4) has N possible solutions: c4 et coe? 2t 


cyednt, with cj, C9,..., Cy as arbitrary constants. We can readily show that a general solution is given by the sum of these N solutions, |] 


so that 


Yo(t) = cre! + coe +-+- + cye™ (2.6) 


where Cj, C2,..., Cy are arbitrary constants determined by N constraints (the auxiliary conditions) on the solution. 


Observe that the polynomial Q(A), which is characteristic of the system, has nothing to do with the input. For this reason the polynomial Q(A) is 
called the characteristic polynomial of the system. The equation 


O(A) =0 (2.7) 


is called the characteristic equation of the system. Equation (2.5c) clearly indicates that ?4, ?2,...,Ay are the roots of the characteristic equation; 
consequently, they are called the characteristic roots of the system. The terms characteristic values, eigenvalues, and natural frequencies are also 
used for characteristic roots.{T] The exponentials elif (i= 1, 2,..., n) in the zero-input response are the characteristic modes (also known as natural 
modes or simply as modes) of the system. There is a characteristic mode for each characteristic root of the system, and the zero-input response is a 
linear combination of the characteristic modes of the system. 


An LTIC system's characteristic modes comprise its single most important attribute. Characteristic modes not only determine the zero-input response 
but also play an important role in determining the zero-state response. In other words, the entire behavior of a system is dictated primarily by its 
characteristic modes. In the rest of this chapter we shall see the pervasive presence of characteristic modes in every aspect of system behavior. 


REPEATED ROOTS 
The solution of Eq. (2.4) as given in Eq. (2.6) assumes that the N characteristic roots ?4, ?2,..., Ay are distinct. If there are repeated roots (same root 


occurring more than once), the form of the solution is modified slightly. By direct substitution we can show that the solution of the equation 


(D — Ay yo(t) = 0 


is given by 


Yo(t) = (Cy + Cal e™ 


In this case the root \ repeats twice. Observe that the characteristic modes in this case are e* and ted. Continuing this pattern, we can show that 
for the differential equation 


(D — 2)" yo(t) =0 (2.8) 


the characteristic modes are e*, te’, 2e?t..., t—1eAt, and that the solution is 


yo(t) = (ey +cat +--+ tet" e™ (2.9) 


Consequently, for a system with the characteristic polynomial 


O(A) = (A — AL) (A — Apa) ++ (A — Ap) 


the characteristic modes are eM tert, leMt ernie eAnt and the solution is 


yo(t) = (cy + Cot +> +c,t" yet +o4,e"" are + cye™ 


COMPLEX ROOTS 

The procedure for handling complex roots is the same as that for real roots. For complex roots the usual procedure leads to complex characteristic 
modes and the complex form of solution. However, it is possible to avoid the complex form altogether by selecting a real form of solution, as 
described next. 


nN 


For a real system, complex roots must occur in pairs of conjugates if the coefficients of the characteristic polynomial Q(A) are to be real. Therefore, if 
« + jB is a characteristic root, « — jB must also be a characteristic root. The zero-input response corresponding to this pair of complex conjugate 
roots is 


Yo(t) = cye* FP + Cre dP# (2.10a) 
For a real system, the response yo(t) must also be real. This is possible only if c, and cz are conjugates. Let 
cq=se” and c= ce 
=—2 ~"s 
This yields 


yo(t) Cp i# pla+iBw + © 4-18 pla-j8u 


c (Be 46 
_ —e@ [el a e IF) 
5 


ce” cos (Bt + 8) (2.10b) 


Therefore, the zero-input response corresponding to complex conjugate roots « + jB can be expressed in a complex form (2.10a) or a real form 
(2.10b). 


EXAMPLE 2.1 


a. Find yo(t), the zero-input component of the response for an LTIC system described by the following differential equation: 


(D? + 3D + 2)y(t) = Dx(t) 
when the initial conditions are yo(0) = 0, Yo(0) = —5. Note that Yo(t), being the zero-input component (x(f) = 0), is the solution of 


(D2 + 3D + 2)yo(t) = 0. 


The characteristic polynomial of the system is A2 + 3A + 2. The characteristic equation of the system is therefore A2 + 3A + 2 = (A + 1) 
(A + 2) = 0. The characteristic roots of the system are A; = —1 and Az = —2, and the characteristic modes of the system are ef and 


e276, Consequently, the zero-input response is 


yo(t) = ce! +e,e7 (2.11a) 


To determine the arbitrary constants c; and co, we differentiate Eq. (2.11a) to obtain 


Yo(t) = —cye! — 2ee°"" (2.11b) 
Setting t = 0 in Eqs. (2.11a) and (2.11b), and substituting the initial conditions yo(0) = 0 and ¥o(O) = —5 we obtain 
0= Cy + C2 
-§5 =-1 — 2 
Solving these two simultaneous equations in two unknowns for c1 and co yields 
a= Co=5 
Therefore 
< J 
yo(t) = —Se* + 5e-7 (2.11c) 


This is the zero-input component of y(t). Because yo(t) is present at f= 0°, we are justified in assuming that it exists for t = ona 


b. A Similar procedure may be followed for repeated roots. For instance, for a system specified by 


(D? + 6D + 9)y(t) = 3D +5)x(t) 


let us determine y(t), the zero-input component of the response if the initial conditions are yg(0) = 3 and Yo(0) =—7. 


The characteristic polynomial is \2+6A+9= (A + 3)?, and its characteristic roots are \4 = —3, Az = —3 (repeated roots). 


Consequently, the characteristic modes of the system are e- 3! and te?! The zero-input response, being a linear combination of the 
characteristic modes, is given by 


Yo(t) = (ce) + cot)e~*" 


We can find the arbitrary constants c, and co from the initial conditions yo(0) = 3 and Yo(0) =-7 following the procedure in part (a). 
The reader can show that c; = 3 and co = 2. Hence, 
yo(t) = (3 + 2t)e* 1>0 

c. For the case of complex roots, let us find the zero-input response of an LTIC system described by the equation 


(D? +4D + 40)y(t) = (D + 2)x(t) 
with initial conditions y9(0) = 2 and Yo(O) = 16.78., 
The characteristic polynomial is A\2 +4 + 40 = (A + 2 — j6)(A + 2 + j6). The characteristic roots are —2 + j6.'t] The solution can be 


written either in the complex form [Eq. (2.10a)] or in the real form [Eq. (2.10b)]. The complex form is yg(t) = c4 edit A2t where M 
= —2 + j6 and Ap = —2 — j6. Since ~ = —2 and B = 6, the real form solution is [see Eq. (2.10b)] 


+ c2e 


yo(t) = ce” cos (6t +) (2.12a) 


where c and @ are arbitrary constants to be determined from the initial conditions yo(0) = 2 and Yo(O) = 16.78 Differentiation of Eq: 
(2.12a) yields 


Yo(t) = —2ce-™ cos (61 + 0) — 6ce™™ sin (61 + 0) (2.12b) 


Setting f = 0 in Eqs. (2.12a) and (2.12b), and then substituting initial conditions, we obtain 
2 = ccos0 


16.78 = —2ccos@ — 6c sind 

Solution of these two simultaneous equations in two unknowns c cos 6 and ¢ sin @ yields 
ccos@? = 2 (2.13a) 
csin@? = —3.463 (2,13b) 


Squaring and then adding the two sides of Eqs. (2.13) yields 
c? = (2)? + (-3.464)" = 16 => c=4 
Next, dividing Eq. (2.13b) by Eq. (2.13a), that is, dividing c sin 8, by c cos 9, yields 


§= 
tan 7) 
and 
—s ( 2863) _2 

2 3 
Therefore 
—2 IT 

yo(t) = 4e-~ cos (6¢ - =) 


For the plot of yo(t), refer again to Fig. B.11c. 


COMPUTER EXAMPLE C2.1 
Find the roots \1 and Az of the polynomial A? + 4) + k for three values of k : 
a. k=3 
b. k=4 
c. k= 40 
>> r = roots ([1 4 3]); 
>> disp (['Case (k=3): roots = [',num2str(r.'),"]']); 
Case (k=3): roots = [-3 -1] 


For k = 3, the polynomial roots are therefore A, = —3 and Ag = —1. 


>> r = roots ([1 4 4]); 
>> disp (['Case (k=4): roots = [',num2str(r.'),']']); 
Case (k=4): roots = [-2 -2] 


For k = 4, the polynomial roots are therefore Ay = Az = —2. 


>> r = roots ([1 4 40]); 
>> disp (['Case (k=40): roots = [',num2str(r.',' %0.5g'),'"]']); 
Case (k=40): roots = [-2+6i -2-6i] 


For k = 40, the polynomial roots are therefore A; = —2 + j6 and Ap = —2 — j6. 
COMPUTER EXAMPLE C2.2 


Consider an LTIC system specified by the differential equation 
, . 
(D*+4D+k)y(t) = 3GD+5)x(t) 


Using initial conditions yo(0) = 3 and yo(0) = —7, determine the zero-input component of the response for three values of k : 
a. k=3 
b. k=4 
c. k=40 


>> disp(['(a) k = 3; y 0 = ',char(y 
( 


(a) k = 3; y 0 = 2*exp(-3*t) + exp 


For k = 3, the zero-input response is therfore yo(t) = 2e3t + et, 


>> y_0 = dsolve('D2y + 4*Dy + 4*y = 0',"y(0) = 3',"Dy(0) = -7','t"); 
>> disp(['(b) k = 4; y 0 = ',char(y 0)]) 
(ob) k = 4; y 0 = 3*exp(-2*t) -exp(-2*t) *t 


For k = 4, the zero-input response is therfore yo(t) = 3e72! — te~2¢. 


>> y_0 = dsolve('D2y + 4*Dy + 40*y = 0','y(0) = 3', 'Dy(0) = -7','t'); 
>> disp(['(c) k = 40; y 0 = ',char(y_0)]) 
(c) k = 40; y 0 = -1/6*exp(-2*t) *sin(6*t) + 3*exp(-2*t) *cos (6*t) 


For k = 40, the zero-input response is therfore 
yo(t) = —4e™ sin (6r) + 3e-* cos (6r) 


EXERCISE E2.1 


Find the zero-input response of an LTIC system described by (D + 5) y (t) = x(t) if the initial condition is y(0) = 5. 9 


Answers 


yo(t)=5e t= 0 


EXERCISE E2.2 


Solve 5 
(D? + 2D)yo (t) = 0 
if yo(0) = 1 and ¥o(0) = 4. 


Answers 


yo(t)=3 —-2e 2 t>0 


PRACTICAL INITIAL CONDITIONS AND THE MEANING OF 07 AND 0* 


In Example 2.1 the initial conditions yg(0) and Yo(0) were supplied. In practical problems, we must derive such conditions from the physical situation. 
For instance, in an RLC circuit, we may be given the conditions (initial capacitor voltages, initial inductor currents, etc.). 


From this information, we need to derive yo(0) ¥o(0), for the desired variable as demonstrated in the next example. 


In much of our discussion, the input is assumed to start at t = 0, unless otherwise mentioned. Hence, t = 0 is the reference point. The conditions 
immediately before t = 0 (just before the input is applied) are the conditions at t = 0°, and those immediately after t = 0 (just after the input is applied) 
are the conditions at t = 0* (compare this with the historical time frame B.C. and A.D.). In practice, we are likely to know the initial conditions at t = 
0” rather than at t = 0*. The two sets of conditions are generally different, although in some cases they may be identical. 


The total response y(t) consists of two components: the zero-input component yo(t) [response due to the initial conditions alone with x(t) = 0] and 
the zero-state component resulting from the input alone with all initial conditions zero. At t = 0°, the total response y(t) consists solely of the zero- 
input component yo(t) because the input has not started yet. Hence the initial conditions on y(t) are identical to those of yg(t). Thus, y(O~) = yg(0°), 
y(0- )= Jo(0-), and so on. Moreover, yo(t) is the response due to initial conditions alone and does not depend on the input x(t). Hence, 
application of the input at t = 0 does not affect y(t). This means the initial conditions on y(t) at f= 07 and 0* are identical; that is yq(0°), yo(0-) 


are identical to yg(0*), Yo(O" ), respectively. It is clear that for yo(t), there is no distinction between the initial conditions at t= 0, 0 and 0*. They are 
all the same. But this is not the case with the total response y(t), which consists of both the zero-input and the zero-state components. Thus, in 
general, y(0-)  y(0*) ¥(O_) # ¥{O"), and so on. 


EXAMPLE 2.2 


A voltage x(t) = 10e73t u(t) is applied at the input of the RLC circuit illustrated in Fig. 2.1a. Find the loop current y(t) for ¢ = 0 if the initial inductor 
current is zero; that is, y(0~) = 0 and the initial capacitor voltage is 5 volts; that is, u,(0") = 5. 


1H 3.0 


x(t) 


(a) 


1H 3 QD 


(b) 


Figure 2.1 


The differential (loop) equation relating y(t) to x(t) was derived in Eq. (1.55) as 
(D? + 3D + 2)y(t) = Dx(t) 


The zero-state component of y(t) resulting from the input x(t), assuming that all initial conditions are zero, that is, y(O") = v,(0 ) = 0, will be obtained 
later in Example 2.6. In this example we shall find the zero-input component yo(t). For this purpose, we need two initial conditions yg(0) and ¥o(0), 


These conditions can be derived from the given initial conditions, y(O~) = 0 and u,(0°) = 5, as follows. Recall that yo(t) is the loop current when the 
input terminals are shorted so that the input x(t) = 0 (zero-input) as depicted in Fig. 2.1b. 


We now compute yo(0) and ¥o(0), the values of the loop current and its derivative at t = 0, from the initial values of the inductor current and the 


capacitor voltage. Remember that the inductor current cannot change instantaneously in the absence of an impulsive voltage. Similarly, the capacitor 
voltage cannot change instantaneously in the absence of an impulsive current. Therefore, when the input terminals are shorted at t = 0, the inductor 
current is still zero and the capacitor voltage is still 5 volts. Thus, 


yo(0) = 0 


To determine ¥o(0), we use the loop equation for the circuit in Fig. 2.1b. Because the voltage across the inductor is L(dyo/dt) or Yo(t), this equation 
can be written as follows: 


Volt) + 3yo(t) + vc(t) = 0 


Setting t = 0, we obtain 
yo(O) + 3y0(0) + ve (0) = 0 


But yg(0) = 0 and v,(0) = 5. Consequently, 
¥o(0) = —5 


Therefore, the desired initial conditions are 


yo(0) = 0 and ¥o(0) = —5 


Thus, the problem reduces to finding yo(t), the zero-input component of y(t) of the system specified by the equation (D2 +3D+ 2)y(t) = Dx(t), when 


the initial conditions are yg(0) = 0 and ¥o(0) = —5. We have already solved this problem in Example 2.1a, where 
we found 
y(t) =—-Se'+5e"% 420 (2.14) 


This is the zero-input component of the loop current y(t). 


It will be interesting to find the initial conditions at t = 0~ and O* for the total response y(t). Let us compare y(0~) and ¥(07) with y(0*) and y(0"). 
The two pairs can be compared by writing the loop equation for the circuit in Fig. 2.1a at t= 07 and t = 0°. The only difference between the two 
situations is that at t= 07, the input x(t) = 0, whereas at t = 0*, the input x(t) = 10 [because x(t) = 10e734], Hence, the two loop equations are 


y(0) + 3y(0-) + ve(0) =0 
y(O7) + 3¥(07) + ve (OT) = 10 


The loop current y(0*) = yO-) = 0 because it cannot change instantaneously in the absence of impulsive voltage. The same is true of the capacitor 
= ane : . ; — offy) — S(T) — 
voltage. Hence, U,(0*) = u,(07) = 5. Substituting these values in the foregoing equations, we obtain y(0 ) = —Sand y (0 j= 5 Thus 


y(O)=0, (0) ==—5 and y(0")=0, ¥(0") =S (2.15) 


EXERCISE E2.3 
In the circuit in Fig. 2.1a, the inductance L = 0 and the initial capacitor voltage v,(0) = 30 volts. Show that the zero-input component of the loop 


current is given by yo(t) = ~10e72/3 for t= 0. 


INDEPENDENCE OF ZERO-INPUT AND ZERO-STATE RESPONSE 

In Example 2.2 we computed the zero-input component without using the input x(t). The zero-state component can be computed from the 
knowledge of the input x(t) alone; the initial conditions are assumed to be zero (system in zero state). The two components of the system response 
(the zero-input and zero-state components) are independent of each other. The two worlds of zero-input response and zero-state response coexist 
side by side, neither one knowing or caring what the other is doing. For each component, the other is totally irrelevant. 


ROLE OF AUXILIARY CONDITIONS IN SOLUTION OF DIFFERENTIAL EQUATIONS 
Solution of a differential equation requires additional pieces of information (the auxiliary conditions). Why? We now show heuristically why a 
differential equation does not, in general, have a unique solution unless some additional constraints (or conditions) on the solution are known. 


Differentiation operation is not invertible unless one piece of information about y(t) is given. To get back y(t) from dy/dt, we must know one piece of 
information, such as y(0). Thus, differentiation is an irreversible (noninvertible) operation during which certain information is lost. To invert this 
operation, one piece of information about y(t) must be provided to restore the original y(t). Using a similar argument, we can show that, given 


d@y/dt?, we can determine y(t) uniquely only if two additional pieces of information (constraints) about y(t) are given. In general, to determine y(t) 
uniquely from its Nth derivative, we need N additional pieces of information (constraints) about y(t). These constraints are also called auxiliary 
conditions. When these conditions are given at t = 0, they are called initial conditions. 


2.2-1 Some Insights into the Zero-Input Behavior of a System 


By definition, the zero-input response is the system response to its internal conditions, assuming that its input is zero. Understanding this 
phenomenon provides interesting insight into system behavior. If a system is disturbed momentarily from its rest position and if the disturbance is 
then removed, the system will not come back to rest instantaneously. In general, it will come back to rest over a period of time and only through a 


special type of motion that is characteristic of the system [t] For example, if we press on an automobile fender momentarily and then release it at t = 


0, there is no external force on the automobile for t > 0.'+] The auto body will eventually come back to its rest (equilibrium) position, but not through 
any arbitrary motion. It must do so by using only a form of response that is sustainable by the system on its own without any external source, since 
the input is zero. Only characteristic modes satisfy this condition. The system uses a proper combination of characteristic modes to come back to the 
rest position while satisfying appropriate boundary (or initial) conditions. 


If the shock absorbers of the automobile are in good condition (high damping coefficient), the characteristic modes will be monotonically decaying 
exponentials, and the auto body will come to rest rapidly without oscillation. In contrast, for poor shock absorbers (low damping coefficients), the 
characteristic modes will be exponentially decaying sinusoids, and the body will come to rest through oscillatory motion. When a series RC circuit 
with an initial charge on the capacitor is shorted, the capacitor will start to discharge exponentially through the resistor. This response of the RC 
circuit is caused entirely by its internal conditions and is sustained by this system without the aid of any external input. The exponential current 
waveform is therefore the characteristic mode of the RC circuit. 


Mathematically we know that any combination of characteristic modes can be sustained by the system alone without requiring an external input. This 
fact can be readily verified for the series RL circuit shown in Fig. 2.2. The loop equation for this system is 


(D + 2)y(t) = x(t) 


x(t) 


Figure 2.2: Modes always get a free ride. 


It has a single characteristic root \ = —2, and the characteristic mode is e-2! We now verify that a loop current y(t) = cet can be sustained through 
this circuit without any input voltage. 


The input voltage x(t) required to drive a loop current y(t) = ce 2! is given by 
dy 


(y= Zh Ry 
x(t) at y) 


d >; 4 
= —(ce”)+2ce“ 
dt 


= —2ce-* + 2ce 
=0 


Clearly, the loop current y(t) = ce2t 


is sustained by the RL circuit on its own, without the necessity of an external input. 


THE RESONANCE PHENOMENON 

We have seen that any signal consisting of a system's characteristic mode is sustained by the system on its own; the system offers no obstacle to 
such signals. Imagine what would happen if we were to drive the system with an external input that is one of its characteristic modes. This would be 
like pouring gasoline on a fire in a dry forest or hiring an alcoholic to taste liquor. An alcoholic would gladly do the job without pay. Think what would 
happen if he were paid by the amount of liquor he tasted! He would work overtime. He would work day and night, until he is burned out. The same 


thing happens with a system driven by an input of the form of characteristic mode. The system response grows without limit, until it burns out.[t] We 
call this behavior the resonance phenomenon. An intelligent discussion of this important phenomenon requires an understanding of the zero-state 
response; for this reason we postpone this topic until Section 2.7-7. 

M1 athi, B. P. Signals and Systems. Berkeley-Cambridge Press, Carmichael, CA, 1987. 

[tlTo prove this assertion, assume that y4(t), yo(t) ... y(t) are all solutions of Eq. (2.4). Then 


QO(D) y(t) = 0 
Q(D)y2x(t) = 0 


QO(D)yx(t) = 0 


Multiplying these equations by cy, Co,..., Cy, respectively, and adding them together yields 
QO(D)[er 1 (f) + cr yo{t) +++: + en ya(t)] = 0 


This result shows that c1y 4(t) + C2yo(t) + ... AX Cyyp(t) is also a solution of the homogeneous equation [Eq. (2.4)]. 
[tl Eigenvalue is German for "characteristic value." 
[tlyo(t) may be present even before t = 0°. However, we can be sure of its presence only from t = 0” onward. 


[tlThe complex conjugate roots of a second-order polynomial can be determined by using the formula in Section B.7-10 or by expressing the 
polynomial as a sum of two squares. The latter can be accomplished by completing the square with the first two terms, as follows: 


02442440 = (07 +4044) 436 = (A + 27 + (67 = (A4+2- J6)A +24 [6) 
[tlThis assumes that the system will eventually come back to its original rest (or equilibrium) position. 


[t]We ignore the force of gravity, which merely causes a constant displacement of the auto body without affecting the other motion. 


[tin practice, the system in resonance is more likely to go in saturation because of high amplitude levels. 


2.3 THE UNIT IMPULSE RESPONSE h(t) 


In Chapter 1 we explained how a system response to an input x(t) may be found by breaking this input into narrow rectangular pulses, as illustrated 
earlier in Fig. 1.27a, and then summing the system response to all the components. The rectangular pulses become impulses in the limit as their 
widths approach zero. Therefore, the system response is the sum of its responses to various impulse components. This discussion shows that if we 
know the system response to an impulse input, we can determine the system response to an arbitrary input x(t). We now discuss a method of 
determining h(t), the unit impulse response of an LTIC system described by the Nth-order differential equation [Eq. (2.1a)] 


O(D)y(t) = P(D)x(t) (2.16a) 


where Q(D) and P(D) are the polynomials shown in Eq. (2.2). Recall that noise considerations restrict practical systems to M < N. Under this 
constraint, the most general case is M = N. Therefore, Eq. (2.16a) can be expressed as 


(D* + a,D*-' +--- +ay_.D + aw)y(t) 
= (by) D* +b, D*—! +--+ + by. D + bw) x(t) (2.16b) 


Before deriving the general expression for the unit impulse response h(t), it is illuminating to understand qualitatively the nature of h(t). The impulse 


response h(t) is the system response to an impulse input 5(t) applied at t = 0 with all the initial conditions zero at f= 0. An impulse input 8(f) is like 
lightning, which strikes instantaneously and then vanishes. But in its wake, in that single moment, objects that have been struck are rearranged. 
Similarly, an impulse input 5(t) appears momentarily at t = 0, and then it is gone forever. But in that moment it generates energy storages; that is, it 


creates nonzero initial conditions instantaneously within the system at t = 0*. Although the impulse input 5(f) vanishes for t > 0 so that the system 
has no input after the impulse has been applied, the system will still have a response generated by these newly created initial conditions. The 


impulse response h(t), therefore, must consist of the system's characteristic modes for t > 0*. As a result 
h(t) = characteristic mode terms 1[>0!' 


This response is valid for t > 0. But what happens at tf = 0? At a single moment ¢ = 0, there can at most be an impulse, [T] so the form of the 
complete response h(f) is 


h(t) = Ao (0) + characteristic mode terms (>0 (2.17) 
because h(t) is the unit impulse response, setting x(t) = 8(t) and y(t) = A(t) in Eq. (2.16b) yields 
(D¥ +a; D8" +---+a~_1D+ay h(t) = (boD* +b, D®-' 4---+by 1 D+by)b() (2.18) 


In this equation we substitute h(t) from Eq. (2.17) and compare the coefficients of similar impulsive terms on both sides. The highest order of the 
derivative of impulse on both sides is N, with its coefficient value as Ag on the left-hand side and bg on the right-hand side. The two values must be 


matched. Therefore, Ag = bg and 
h(t) = bod (tf) + characteristic modes (2.19) 


In Eq. (2.16b), if M< N, bo = 0. Hence, the impulse term b98(f) exists only if M = N. The unknown coefficients of the N characteristic modes in h(t) 
in Eq. (2.19) can be determined by using the technique of impulse matching, as explained in the following example. 


EXAMPLE 2.3 
Find the impulse response h(t) for a system specified by 


(D? + 5D + 6)y(t) = (D + I)x(t) (2.20) 


In this case, bg = 0. Hence, A(t) consists of only the characteristic modes. The characteristic polynomial is M2 +5X46=(A4 2)(A + 3). The roots 
are —2 and —3. Hence, the impulse response h(f) is 

h(t) = (ec, e"™" + ce") u(t) (2.21) 
letting x(t) = 8(f) and y(t) = A(t) in Eq. (2.20), we obtain 

h(t) + Sh(t) + 6h(t) = 4(t) + (1) (2.22) 
Recall that initial conditions h(O”) and h(O~) are both zero. But the application of an impulse at t = 0 creates new initial conditions at t = 0*. Let 
h(0*) = K, and t(O~) = K2. These jump discontinuities in h(t) and /1(1) at t = 0 result in impulse terms (0) = K,4(f) and 
h(Q) = K,4(t) + K28(0) on the left-hand side. Matching the coefficients of impulse terms on both sides of Eq. (2.22) yields 
5Ki+K2.=1. K,=1 = K,=1,K,=-4 
We now use these values h(0*) = Ky, = 1 and (07) = K2= — 4 in Eq. (2.21) to find c, and co. Setting t = 0* in Eq. (2.21), we obtain cy + cp = 
1. Also setting t = 0* in A(t), we obtain —2c, —3c1 = —4. These two simultaneous equations yield c; = —1 and cz = 2. Therefore 

an’) —3 

h(t) = (—e~" +2e u(t) 
Although, the method used in this example is relatively simple, we can simplify it still further by using a modified version of impulse matching. 


SIMPLIFIED IMPULSE MATCHING METHOD 
The alternate technique we present now allows us to reduce the procedure to a simple routine to determine h(t). To avoid the needless distraction, 
the proof for this procedure is placed in Section 2.8. There, we show that for an LTIC system specified by Eq. (2.16), the unit impulse response h(t) 


is given by 
h(t) = bod (t) + [P(D) yn (t) u(t) (2.23) 

where y,(t) is a linear combination of the characteristic modes of the system subject to the following initial conditions: 
Yn(O) = He(0) = (0) eee yO) =0 and = yO) = 1 (2.24a) 


where yk) (0) is the value of the kth derivative of y,(t) at f= 0. We can express this set of conditions for various values of N (the system order) as 
follows: 


N=1: y,(0)=1 

N =2: y,(0) =0, 3,(0) = 1 

N =3: yn(0) = (0) = 0, §,(0) = 1 (2.24b) 
and so on. 


As stated earlier, if the order of P(D) is less than the order of Q(D), that is, if M< N, then bo = 0, and the impulse term 698(t) in h(t) is zero. 


EXAMPLE 2.400 - 
Determine the unit impulse response h(t) for a system specified by the equation 
(D*? + 3D +2) y(t) = Dx(t) (2.25) 


This is a second-order system (N = 2) having the characteristic polynomial 


(A7+3A +2) = (A+ 1)(A +2) 
The characteristic roots of this system are \ = —1 and A = —2. Therefore 
y(t) =e' +07 (2.26a) 
Differentiation of this equation yields 
In(t) = —cre! — 2ee-™ (2.26b) 


The initial conditions are [see Eq. (2.24b) for N = 2] 
yn(0) = 1 and y, (0) = 0 


Setting t= 0 in Eqs. (2.26a) and (2.26b), and substituting the initial conditions just given, we obtain 


0=e,4+¢2 
= —¢C1 —2¢2 
Solution of these two simultaneous equations yields 
a=! and @=-1 
Therefore 


y,(t) =@ — en! 


Moreover, according to Eq. (2.25), P(D) = D, so that 
P(D)yn(t) = Dyn(t) = Jn(t) = —e~' + 20 
Also in this case, bg = 0 [the second-order term is absent in P(D)]. Therefore 


h(t) = [P(D)yn(t)Ju(t) = (—e" + 2e-™ u(t) 


Comment. In the above discussion, we have assumed M < N, as specified by Eq. (2.16b). Appendix 2.1 (i.e., Section 2.8) shows that the 
expression for h(t) applicable to all possible values of M and N is given by 


h(t) = P(D)[yn(t)u(o] 


where y,(t) is a linear combination of the characteristic modes of the system subject to initial conditions (2.24). This expression reduces to Eq. (2.23) 
when M<N. 


Determination of the impulse response h(t) using the procedure in this section is relatively simple. However, in Chapter 4 we shall discuss another, 
even simpler method using the Laplace transform. 


EXERCISE E2.4 


Determine the unit impulse response of LTIC systems described by the following equations: 9 
a. (D + 2)y(t) = (3D + 5)x(t) 
b. D(D + 2)y(t) = (D + 4)x(t) 


c. (D2 + 2D + 1)y(t) = Dx(t) 


Answers 


a. 38(t) — e-2fu(t) 
b. (2 — e 4yu(t) 


c. (1 — the tu(t) 


COMPUTER EXAMPLE C2.3 
Determine the impulse response h(t) for an LTIC system specified by the differential equation 


(D? + 3D + 2)y(t) = Dx(t) 


This is a second-order system with bo = 0. First we find the zero-input component for initial conditions y(0O”) = 0, and ¥(0-) = 1 Since P(D) = D, 
the zero-input response is differentiated and the impulse response immediately follows. 

>> yn = desolve ('D2y+3*Dy+2*y=0','y (0)=0', 'Dy (0)=1', 't"); 

>> Dy n = diffy (y_n); 

>> disp(['h(t) = (",char (Dy _n),') u (t)']); 

h(t) = (-exp(-t)+2*exp (-2*t))u(t) 


Therefore, h(t) = 698(t) + [Dyo(t)]u(t) = (—e7! + 2e72%)u(t). 


SYSTEM RESPONSE TO DELAYED IMPULSE 

If h(t) is the response of an LTIC system to the input 8(t), then h(t — T) is the response of this same system to the input 6(t — 7). This conclusion 
follows from the time-invariance property of LTIC systems. Thus, by knowing the unit impulse response h(t), we can determine the system response 
to a delayed impulse 8(t — 7). 


[tit might be possible for the derivatives of 5(t) to appear at the origin. However, if M < N, it is impossible for h(t) to have any derivatives of 8(f). 
This conclusion follows from Eq. (2.16b) with x(t) = 8(t) and y(t) = h(t). The coefficients of the impulse and all its derivatives must be matched on 


both sides of this equation. If h(t) contains 8(1)(2), the first derivative of 8(t), the left-hand side of Eq. (2.16b) will contain a term B(N*1)(£), But the 


highest-order derivative term on the right-hand side is 8 (NYE). Therefore, the two sides cannot match. Similar arguments can be made against the 
presence of the impulse's higher-order derivatives in h(t). 


2.4 SYSTEM RESPONSE TO EXTERNAL INPUT: ZERO-STATE RESPONSE 


This section is devoted to the determination of the zero-state response of an LTIC system. This is the system response y(f) to an input x(t) when the 
system is in the zero state, that is, when all initial conditions are zero. We shall assume that the systems discussed in this section are in the zero 
state unless mentioned otherwise. Under these conditions, the zero-state response will be the total response of the system. 


We shall use the superposition property for finding the system response to an arbitrary input x(t). Let us define a basic pulse p(t) of unit height and 
width AT, starting at t = 0 as illustrated in (Fig. 2.3a). Figure 2.3b shows an input x(t) as a sum of narrow rectangular pulses. The pulse starting at ¢ 
= nAT in Fig. 2.3b has a height x(nAT), and can be expressed as x(nAT)p(t — nAT). Now, x(t) is the sum of all such pulses. Hence 


[x(nAr) 
i= : -_ r= li | 
x{t) Jim, 5 x(nAr)p(t —nAr) Jim, 5 | 


p(t =—nArjAr (2.27) 
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Figure 2.3: Finding the system response to an arbitrary input x(t). 


The term [x(nAt)/AT]p(t — nAt) represents a pulse p(t — nAT) with height [x(nAtT)/At]. As At — 0, the height of this strip — oo, but its area 
remains x(nAT). Hence, this strip approaches an impulse x(nAT)d(t — nAT) as At — 0 (Fig. 2.3e). Therefore 


x(t) = lim So x(ndr)s(t —nAtr)Ar (2.28) 
Ar-0 : 


To find the response for this input x(t), we consider the input and the corresponding output pairs, as shown in Fig. 2.3c-2.3f and also shown by 

directed arrow notation as follows: 
input 
5(t) 


output 
A(t) 


[x(nAr)Ar|é(t —nAr) 


—2 
=» 

5(t—nAr) = > h(t—ndAr) 
==> [x(nAr)Ar|h(t —nAr) 
—: 


fim, SO x(n Ar )s(t —ndAr)Ar jim, SO x(n Ar Jatt —nAr)Ar 
t rt 


x(t) [see Ba, (2.28)) win) 


Thereforelt] 


yn= f x(t)h(t, cr) dtr 


=<) 


This is the result we seek. We have obtained the system response y(¢) to an arbitrary input x(t) in terms of the unit impulse response h(t). Knowing 
h(t), we can determine the response y(t) to any input. Observe once again the all-pervasive nature of the system's characteristic modes. The system 
response to any input is determined by the impulse response, which, in turn, is made up of characteristic modes of the system. 


It is important to keep in mind the assumptions used in deriving Eq. (2.29). We assumed a linear, time-invariant (LT) system. Linearity allowed us to 
use the principle of superposition, and time invariance made it possible to express the system's response to 8(t — nAT) as h(t — nAt). 


2.4-1 The Convolution Integral 


The zero-state response y(t) obtained in Eq. (2.29) is given by an integral that occurs frequently in the physical sciences, engineering, and 
mathematics. For this reason this integral is given a special name: the convolution integral. The convolution integral of two functions x(t) and x2(t) 
is denoted symbolically by x; (t) * x2(t) and is defined as 


nN 
noen= | X1(t)x2(t —t)dr (2.30) 


a 


Some important properties of the convolution integral follow. 


THE COMMUTATIVE PROPERTY 
Convolution operation is commutative; that is, x4 (f) * x2(t) = xa(t) * x1 (tf). This property can be proved by a change of variable. In Eq. (2.30), if we 
let z= t-— T so that T = t — z and dT = —dz, we obtain 


X,(t) * X(t) 


—_ 
-{ X2(z)xX\(t — z)dz 


~~ 


/ x2(z)x, (1 — z) dz 


~ 


= X2(f) * x, (1) (2.31) 


THE DISTRIBUTIVE PROPERTY 
According to the distributive property, 


X10) * frat) + x3(O] = (0 & ant) + 1D) #.43(0) (2.32) 


THE ASSOCIATIVE PROPERTY 
According to the associative property, 


x1(0) * fe2(f) 4.33(0] = Ii) *x2(O] #231) (2.33) 
The proofs of Eqs. (2.32) and (2.33) follow directly from the definition of the convolution integral. They are left as an exercise for the reader. 


THE SHIFT PROPERTY 


n() #000) = c(t) 
then 

xi(0) * x2 — T) = x(t —T) #x2(1) = c(t — T) (2.34a) 
and 

xi(t — Ti) #x2(t — Tr) = c(t — T, — Tr) (2.34b) 


Proof. We are given 


oo 
nanan = [ Xi (T)X2(t — t)dt = c(t) 


Therefore 
= 


X1(t) * x(t — T) =| x (t)x2(t —T —1)dt 


—oO 
=c(t—T) 
Equation (2.34b) follows from Eq. (2.34a). 


CONVOLUTION WITH AN IMPULSE 
Convolution of a function x(t) with a unit impulse results in the function x(t) itself. By definition of convolution 


= 
x(t) *4(r) -/ x(r)d(t —r)dr (2.35) 


3 


Because 8(t — T) is an impulse located at tT = t, according to the sampling property of the impulse [Eq. (1.24)], the integral in Eq. (2.35) is the value 
of x(T) at T =f, that is, x(t). Therefore 


x(t) *d(t) = x(t) (2,36) 
Actually this result was derived earlier [Eq. (2.28)]. 


THE WIDTH PROPERTY 
If the durations (widths) of x1 (ft) and x(t) are finite, given by 7, and To, respectively, then the duration (width) of x4 (ft) * xo(t) is 7, + To (Fig. 2.4). 
The proof of this property follows readily from the graphical considerations discussed later in Section 2.4-2. 


Figure 2.4: Width property of convolution. 


ZERO-STATE RESPONSE AND CAUSALITY 


The (zero-state) response y(t) of an LTIC system is 


y(t) = x(t) A(t) -/ 


oo 


In deriving Eq. (2.37), we assumed the system to be linear and time invariant. There were no other restrictions either on the system or on the input 
signal x(t). In practice, most systems are causal, so that their response cannot begin before the input. Furthermore, most inputs are also causal, 


x 


x(r)A(t—r)dr 


which means they start at tf = 0. 


Causality restriction on both signals and systems further simplifies the limits of integration in Eq. (2.37). By definition, the response of a causal 
system cannot begin before its input begins. Consequently, the causal system's response to a unit impulse 8(f) (which is located at t = 0) cannot 
begin before t = 0. Therefore, a causal system's unit impulse response h(t) is a causal signal. 


It is important to remember that the integration in Eq. (2.37) is performed with respect to T (not f). If the input x(t) is causal, x(T) = 0 for T < 0. 
Therefore, x(t) = 0 for T < 0, as illustrated in Fig. 2.5a. Similarly, if h(t) is causal, h(t — T) = 0 for t — Tt < 0; that is, for T > t, as depicted in Fig. 
2.5a. Therefore, the product x(t)h(t — T) = 0 everywhere except over the nonshaded interval 0 < T < t shown in Fig. 2.5a (assuming ft = 0). 
Observe that if fis negative, x(T)h(t — T) = 0 for all T as shown in Fig. 2.5b. Therefore, Eq. (2.37) reduces to 


a 
yin =xnan = f x(c)h(t—t)dr t>0 


=0 


x(7) = 0 


x(7) 


1<0 


(b) 


Figure 2.5: Limits of the convolution integral. 


The lower limit of integration in Eq. (2.38a) is taken as 0 to avoid the difficulty in integration that can arise if x(t) contains an impulse at the origin. 
This result shows that if x(t) and h(t) are both causal, the response y(t) is also causal. 


Because of the convolution's commutative property [Eq. (2.31)], we can also express Eq. (2.38a) as [assuming causal x(t) and h(f)] 


i 
y= f A(r)x(t—t)drt t>0 


=0 


Hereafter, the lower limit of O° will be implied even when we write it as 0. As in Eq. (2.38a), this result assumes that both the input and the system 


are causal. 


EXAMPLE 2.5 


For an LTIC system with the unit impulse response h(t) = e 2tu(t), determine the response y(t) for the input 


x(t) =e u(t) 


Here both x(t) and h(t) are causal (Fig. 2.6). Hence, from Eq. (2.38a), we obtain 


t<0 


yin = | x(t)h(t —t)dt t>0 
0 


(2.37) 


(2.38a) 


(2.38b) 


(2.39) 


{a) {b) 


Figure 2.6: Convolution of x(t) and A(t). 


Because x(t) = etu(t) and h(t) = e 2tu(t) 


x(t) =eu(r) and = A(t—1) =e" u(t —1) 


Remember that the integration is performed with respect to T (not f), and the region of integration is 0 < T < t. Hence, < 0 andt-—T = 0. 


Therefore, u(t) = 1 and u(t — T) = 1; consequently 


' 
y(t) =| ete“ dr t2>0 
0 


Because this integration is with respect to T, we can pull e~2! outside the integral, giving us 


yy me f et dr =e Me - 1) =e" 1>0 
6 


Moreover, y(t) = 0 when t < O [see Eq. (2.38a)]. Therefore 


y(t) =(e' —e u(t) 


The response is depicted in Fig. 2.6c. 


EXERCISE E2.5 


For an LTIC system with the impulse response h(t) = 6e ‘u(t), determine the system response to the 


input: 
a. 2u(t) 
b. 3e u(t) 


Answers 


a. 12(1-e u(t) 


b. Qe? — eu(t) 


EXERCISE E2.6 


Repeat Exercise E2.5 for the input x(t) = 
etu(t). 


Answers 


6te u(t) 


THE CONVOLUTION TABLE 


The task of convolution is considerably simplified by a ready-made convolution table (Table 2.1). This table, which lists several pairs of signals and 


their convolution, can conveniently determine y (t), a system response to an input x(t), without performing the tedious job of integration. For instance, 
we could have readily found the convolution in Example 2.5 by using pair 4 (with A = — 1 and A = —2) to be (et = e hu(t), The following example 


demonstrates the utility of this table. 


Table 2.1: Convolution Table 
= Open table as spreadsheet 


x4(t) |[x2(t) [x1(t)*x2(t) = x2(t)*x4(t) 


i x(t — T) 
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EXAMPLE 2.6 


Find the loop current y(t) of the RLC circuit in Example 2.2 for the input x(t) = 10e%u(t), when all the initial conditions are zero. 


The loop equation for this circuit [see Example 1.10 or Eq. (1.55)] is 


(D? + 3D + 2)y(t) = Dx(t) 


The impulse response h(t) for this system, as obtained in Example 2.4, is 


h(t) = (2e-* — e)utt) 


The input is x(t) = 10e~$ t x u(t), and the response y(t) is 
y(t) = x(t) # A(t) 


= 10e~" u(t) * [2e-" — e* Jun) 


Using the distributive property of the convolution [Eq. (2.32)], we obtain 
y(t) = 10e* u(t) * 2e-* u(t) — 106 * u(t) * e u(t) 


= 20fe~* u(r) * eo“ u(t)| — 10[e* u(t) *« em u(t)] 


Now the use of pair 4 in Table 2.1 yields 


20 . 10 
y(t) = ———I[e~* — e-* Ju(t) — ———[e™ — e"Jut 
w= SED a ae 


M 


= —20(e°* — e*)u(t) + 5(e* — e u(t) 


(—Se™ + 20e7-% — 15e7™ )u(r) 


EXERCISE E2.7 
Rework Exercises E2.5 and E2.6 using the convolution table. 


fat 


Use the convolution table to determine 2) 
elt) & (L — ee u(t) ° 
Answers 


(1/2 - ef + 1/2e72¢)u(t) 


EXERCISE E2.9 


For an LTIC system with the unit impulse response h(t) = e2tu(t), determine the zero-state response y(f) if the input aF 
x(t) = sin 3¢ u(t). [Hint: Use pair 12 from Table 2.1.] 7 


Answers 


1 [3e-* + /13 cos (34 — 146.32°)]u(t) 


1 [3e-% — /13 cos (3¢ + 33.68°)Ju(t) 


RESPONSE TO COMPLEX INPUTS 
The LTIC system response discussed so far applies to general input signals, real or complex. However, if the system is real, that is, if h(t) is real, 
then we shall show that the real part of the input generates the real part of the output, and a similar conclusion applies to the imaginary part. 


If the input is x (t) = x, (t) + jx; (t), where x; (tf) and x; (tf) are the real and imaginary parts of x(t), then for real h(t) 
y(t) = A(t) * De) + 7x2) = hd) * XD + FAD) #(D = yD) + iD) 


where y(t) and y;(t) are the real and the imaginary parts of y(t). Using the right-directed arrow notation to indicate a pair of the input and the 
corresponding output, the foregoing result can be expressed as follows. If 
XO=—xA)+ IT) => ywt)= y(t) + Jy 


then 
xt) => y(t) 
xt) = Vi (t) (2.40) 


MULTIPLE INPUTS 

Multiple inputs to LTI systems can be treated by applying the superposition principle. Each input is considered separately, with all other inputs 
assumed to be zero. The sum of all these individual system responses constitutes the total system output when all the inputs are applied 
simultaneously. 


2.4-2 Graphical Understanding of Convolution Operation 


Convolution operation can be grasped readily by examining the graphical interpretation of the convolution integral. Such an understanding is helpful in 
evaluating the convolution integral of more complex signals. In addition, graphical convolution allows us to grasp visually or mentally the convolution 
integral's result, which can be of great help in sampling, filtering, and many other problems. Finally, many signals have no exact mathematical 
description, so they can be described only graphically. If two such signals are to be convolved, we have no choice but to perform their convolution 
graphically. 


We shall now explain the convolution operation by convolving the signals x(t) and g(t), illustrated in Fig. 2.7a and 2.7b, respectively. If c(t) is the 
convolution of x(t) with g(t), then 


~ 
c(t) -/ x(r)e(t—t)dt (2.41) 


ss 


t 3 t 0 ' i 


Figure 2.7: Graphical explanation of the convolution operation. 


One of the crucial points to remember here is that this integration is performed with respect to T, so that t is just a parameter (like a constant). This 
consideration is especially important when we sketch the graphical representations of the functions x(T) and g(t — T) appearing in the integrand of 
Eq. (2.41). Both these functions should be sketched as functions of T, not of t. 


The function x(T) is identical to x(t), with T replacing t (Fig. 2.7c). Therefore, x(t) and x(T) will have the same graphical representations. Similar 
remarks apply to g(t) and g(T) (Fig. 2.7d). 


To appreciate what g(t — T) looks like, let us start with the function g(T) (Fig. 2.7d). Time reversal of this function (reflection about the vertical axis T 
= 0 yields g(— T) (Fig. 2.7e). Let us denote this function by (T) 


o(t) = g(—-T) 

Now (T) shifted by t seconds is (tT — 1), given by 

d(ct —t) = g[-—(t —D)] = e(t — 7) 

Therefore, we first time-reverse g(— T) to obtain g(— T) and then time-shift g(— T) by t to obtain g(t— T). For positive t, the shift is to the right (Fig. 
2.7f); for negative ¢, the shift is to the left (Fig. 2.7g, 2.7h). 


The preceding discussion gives us a graphical interpretation of the functions x(T) and g(t — T). The convolution c(t) is the area under the product of 
these two functions. Thus, to compute c(t) at some positive instant t = t,, we first obtain g(—T) by inverting g(t) about the vertical axis. Next, we 


right-shift or delay g(—T) by ft, to obtain g(t; — T) (Fig. 2.7f), and then we multiply this function by x(T), giving us the product x(T)g(t; — T) (shaded 
portion in Fig. 2.7f). The area A; under this product is c(t,), the value of c(t) at t = t;. We can therefore plot c(t,) = A; on a curve describing c(t), as 
shown in Fig. 2.7i. The area under the product x(T)g(T) in Fig. 2.7e is c(0), the value of the convolution for t = 0 (at the origin). 


A similar procedure is followed in computing the value of c(t) at t = tp, where fg is negative (Fig. 2.7g). In this case, the function g(— T) is shifted by 
a negative amount (that is, left-shifted) to obtain g(t2 — T). Multiplication of this function with x(T) yields the product x(T)g(t2 — T). The area under 
this product is c(t2) = Az, giving us another point on the curve c(t) at t = ty (Fig. 2.7i). This procedure can be repeated for all values of t, from — © 


to co. The result will be a curve describing c(t) for all time t. Note that when t < —3, g(t) and g(t — T) do not overlap (see Fig. 2.7h); therefore, c(t) 
=0 fort < —3. 


SUMMARY OF THE GRAPHICAL PROCEDURE 
The procedure for graphical convolution can be summarized as follows 
1. Keep the function x(T) fixed. 
2. Visualize the function g(T) as a rigid wire frame, and rotate (or invert) this frame about the vertical axis (T = 0) to obtain g(— T). 


3. Shift the inverted frame along the T axis by fg seconds. The shifted frame now represents g(to — T). 


4. The area under the product of x(t) and g(to — T) (the shifted frame) is c(fg), the value of the convolution at f = fo. 


5. Repeat this procedure, shifting the frame by different values (positive and negative) to obtain c(t) for all values of f. 


The graphical procedure discussed here appears very complicated and discouraging at first reading. Indeed, some people claim that convolution has 
driven many electrical engineering undergraduates to contemplate theology either for salvation or as an alternative career (IEEE Spectrum, March 


1991, p. 60).[1] Actually, the bark of convolution is worse than its bite. In graphical convolution, we need to determine the area under the product 


x(T)g(t — T) for all values of t from —co to co. However, a mathematical description of x(T)g(t —T) is generally valid over a range of t. Therefore, 
repeating the procedure for every value of t amounts to repeating it only a few times for different ranges of ft. 


Convolution: its bark is worse than its bite! 


We can also use the commutative property of convolution to our advantage by computing x(t) * g(t) or g(t) * x(t), whichever is simpler. As a rule of 
thumb, convolution computations are simplified if we choose to invert (time-reverse) the simpler of the two functions. For example, if the mathematical 
description of g(t) is simpler than that of x(t), then x(t) * g(t) will be easier to compute than g(t) * x(t). In contrast, if the mathematical description of 
x(t) is simpler, the reverse will be true. 


We shall demonstrate graphical convolution with the following examples. Let us start by using this graphical method to rework Example 2.5. 


EXAMPLE 2.7 

Determine graphically y(t) = x(t) * h(t) for x(t) = e~fu(t) and A(t) = e~“u(t). 

In Fig. 2.8a and 2.8b we have x(t) and h(t), respectively; and Fig. 2.8c shows x(T) and h (—T) as functions of T. The function h(t — T) is now 
obtained by shifting h(— T) by ft. If tis positive, the shift is to the right (delay); if tis negative, the shift is to the left (advance). Figure 2.8d shows that 


for negative t, h(t — T) [obtained by left-shifting h(— T)] does not overlap x(T), and the product x(T)h(t — T) = 0, so that 
y(t) =0 t<0 


Figure 2.8: Convolution of x(t) and h(t). 


Figure 2.8e shows the situation for t > 0. Here x(t) and h(t — T) do overlap, but the product is nonzero only over the interval 0 < T < ¢ (shaded 
interval). Therefore 


i 
y(t) =| x(t)h(t —t)dt t>0 
0 


All we need to do now is substitute correct expressions for x(T) and h(t — T) in this integral. From Fig. 2.8a and 2.8b it is clear that the segments of 
x(t) and g(t) to be used in this convolution (Fig. 2.8e) are described by 


x@)=e" and = A(t) =e 


Therefore 
x(t) =e 


Tt 


and = A(t —t) = e@2"-”? 
Consequently 
t 


y= | ete" 74-9 dr 
0 


I 
=e Py e’dt 
0 


=e? —e t>0 


Moreover, y(t) = 0 for t < 0, so that 


y(t) = (e' —e™ u(t) 


EXAMPLE 2.8 


Find c(t) = x(t) * g(t) for the signals depicted in Fig. 2.9a and 2.9b. 


Since x(t) is simpler than g(t), it is easier to evaluate g(t) * x(t) than x(t) * g(t). However, we shall intentionally take the more difficult route and 
evaluate x(t) * g(t). 


From x(t) and g(t) (Fig. 2.9a and 2.9b, respectively), observe that g(t) is composed of two segments. As a result, it can be described as 


ae segment A 
g(t)=y 
—2e* segment B 


<> 2 
“i 
| - i 
1 Segmacet A 


| 
—s 


«> 


Figure 2.9: Convolution of x(t) and g(f). 


Therefore 
2e-%-*) segment A 
gil i dae 2(t—t) 
—2e*"-* segment B 
The segment of x(t) that is used in convolution is x(t) = 1, so that x(T) = 1. Figure 2.9c shows x(T) and g(—T). 


To compute c(t) for tf => 0, we right-shift g(—T) to obtain g(t — T), as illustrated in Fig. 2.9d. Clearly, g(t — T) overlaps with x(T) over the shaded 
interval, that is, over the range => 0; segment A overlaps with x(T) over the interval (0, t), while segment B overlaps with x(T) over (f, 0). 
Remembering that x(T) = 1, we have 


oO 
c(t) = [ x(t)g(t—t)dt 
JO 


i a) 
nis | 2e-"- dr te [ —2e%t-") dt 
0 t 


=2(1-—e")-1 
=1-2e"' t>0 
Figure 2.9e shows the situation for t < 0. Here the overlap is over the shaded interval, that is, over the range T > 0, where only the segment B of 


g(t) is involved. Therefore 
oO 


ct) = X(t)g(t —t)dt 


0 


- | g(t —t)dt 
0 


OO 
-| —2ertt dt 
Q 


= —¢7! t<0 


Therefore 

1—2e t>0 
c(t) = 

—e t<0 


Figure 2.9f shows a plot of c(¢). 


EXAMPLE 2.9 


Find x(t) * g(t) for the functions x(t) and g(t) shown in Fig. 2.10a and 2.10b. 


Figure 2.10: Convolution of x(t) and g(?). 


Here, x(t) has a simpler mathematical description than that of g(t), so it is preferable to time-reverse x(t). Hence, we shall determine g(t) * x(t) rather 
than x(t) * g(t). Thus 


c(t) = g(t) * x(t) 


= / g(t)x(t—t)dt 


oo 


First, we determine the expressions for the segments of x(t) and g(t) used in finding c(t). According to Fig. 2.10a and 2.10b, these segments can be 
expressed as 


x(t)=1 and = g(t) = 4 


so that 
x(t—t)=1 and = g(t)=3r 


Figure 2.10c shows g(T) and x(— T), whereas Fig. 2.10d shows g(T) and x(t — T), which is x(t) shifted by t. Because the edges of x(— T) are at T = 
— 1 and 1, the edges of x(t — T) are at — 1 + t and 1 + ¢. The two functions overlap over the interval (0,1 + t)(shaded interval), so that 


Ist 
c(t) -/ a(t)x(t—r)dt 


led 
= L 
-/ stdt 
0 


= h(+1) -l<t<! (2.42a) 
This situation, depicted in Fig. 2.10d, is valid only for — 1 < t < 1. Fort < 1 but < 2, the situation is as illustrated in Fig. 2.10e. The two functions 


overlap only over the range — 1+ f to 1 + ¢ (shaded interval). Note that the expressions for g(t) and x(t — T) do not change; only the range of 
integration changes. Therefore 


loz 
1 
j $t dt 
lye 


=% l<1<2 (2,42b) 


c(t) 


Also note that the expressions in Eqs. (2.42a) and (2.42b) both apply at t = 1, the transition point between their respective ranges. We can readily 
verify that both expressions yield a value of 2/3 at t= 1, so that c(1) = 2/3. The continuity of c(t) at transition points indicates a high probability of a 


right answer. Continuity of c(t) at transition points is assured as long as there are no impulses at the edges of x(t) and g(t). 


For t = 2 but < 4 the situation is as shown in Fig. 2.10f. The functions g(t) and x(t — T) overlap over the interval from — 1 + tf to 3 (shaded 
interval), so that 


ct) = f itdt 
~l+t 


=-}(?-21-8) 2<1<4 (2.42c) 
Again, both Eqs. (2.42b) and (2.42c) apply at the transition point t = 2. We can readily verify that c(2) = 4/3 when either of these expressions is used. 


For t => 4, x(t — T) has been shifted so far to the right that it no longer overlaps with g(T) as depicted in Fig. 2.10g. Consequently 


ct)=0 ¢24 (2.42d) 
We now turn our attention to negative values of t. We have already determined c(t) up to t= — 1. For t < — 1 there is no overlap between the two 
functions, as illustrated in Fig. 2.10h, so that 

c(t) =0 t<-l (2.42e) 


Figure 2.10i plots c(t) according to Eqs. (2.42a) through (2.42e). 


WIDTH OF THE CONVOLVED FUNCTION 

The widths (durations) of x(t), g(t), and c(t) in Example 2.9 (Fig. 2.10) are 2, 3, and 5, respectively. Note that the width of c(t) in this case is the sum 
of the widths of x(t) and g(t). This observation is not a coincidence. Using the concept of graphical convolution, we can readily see that if x(t) and 
g(t) have the finite widths of T; and T> respectively, then the width of c(t) is equal to T, + Tp. The reason is that the time it takes for a signal of 


width (duration) T, to completely pass another signal of width (duration) T> so that they become nonoverlapping is 7; + Tz. When the two signals 
become nonoverlapping, the convolution goes to zero. 


EXERCISE E2.10 
Rework Example 2.8 by evaluating g(t) * x(t) 


EXERCISE E2.11 


Use graphical convolution to show that x(t) * = c(t) in Fig. 2.11. 


0 ‘= 


Figure 2.11: Convolution of x(t) and g(t). 


EXERCISE E2.12 
Repeat Exercise E2.11 for the functions in Fig. 2.12. 


g(t) 
ia ra) ! 


iN. 


Field 2.12: Convolition of x(t ane g(t 


EXERCISE E2.13 
Repeat Exercise E2.11 for the functions in Fig. 2.13. 


gt 
UES / 


igure 2.13: Convelution ae x(t ‘aha g(t 


THE PHANTOM OF THE SIGNALS AND SYSTEMS OPERA 
In the study of signals and systems we often come across some signals such as an impulse, which cannot be generated in practice and have never 


been sighted by anyone. |T] One wonders why we even consider such idealized signals. The answer should be clear from our discussion so far in this 
chapter. Even if the impulse function has no physical existence, we can compute the system response h(t) to this phantom input according to the 
procedure in Section 2.3, and knowing h(t), we can compute the system response to any arbitrary input. The concept of impulse response, therefore, 
provides an effective intermediary for computing system response to an arbitrary input. In addition, the impulse response h(t) itself provides a great 
deal of information and insight about the system behavior. In Section 2.7 we show that the knowledge of impulse response provides much valuable 
information, such as the response time, pulse dispersion, and filtering properties of the system. Many other useful insights about the system behavior 


can be obtained by inspection of h(t). 


Similarly, in frequency-domain analysis (discussed in later chapters), we use an everlasting exponential (or sinusoid) to determine system response. 
An everlasting exponential (or sinusoid) too is a phantom, which no-body has ever seen and which has no physical existence. But it provides another 
effective intermediary for computing the system response to an arbitrary input. Moreover, the system response to everlasting exponential (or sinusoid) 
provides valuable information and insight regarding the system's behavior. Clearly, idealized impulse and everlasting sinusoids are friendly and helpful 
spirits. 


Interestingly, the unit impulse and the everlasting exponential (or sinusoid) are the dual of each other in the time-frequency duality, to be studied in 
Chapter 7. Actually, the time-domain and the frequency-domain methods of analysis are the dual of each other. 


WHY CONVOLUTION? AN INTUITIVE EXPLANATION OF SYSTEM RESPONSE 

On the surface, it appears rather strange that the response of linear systems (those gentlest of the gentle systems) should be given by such a 
tortuous operation of convolution, where one signal is fixed and the other is inverted and shifted. To understand this odd behavior, consider a 
hypothetical impulse response h(t) that decays linearly with time (Fig. 2.14a). This response is strongest at t = 0, the moment the impulse is applied, 
and it decays linearly at future instants, so that one second later (at t= 1 and beyond), it ceases to exist. This means that the closer the impulse 
input is to an instant t, the stronger is its response at t. 


bir 


(a> ib) 


Figure 2.14: Intuitive explanation of convolution. 


Now consider the input x(t) shown in Fig. 2.14b. To compute the system response, we break the input into rectangular pulses and approximate 
these pulses with impulses. Generally the response of a causal system at some instant f will be determined by all the impulse components of the 
input before t. Each of these impulse components will have different weight in determining the response at the instant t, depending on its proximity to 
t. As seen earlier, the closer the impulse is to ¢, the stronger is its influence at t. The impulse at t has the greatest weight (unity) in determining the 
response at t. The weight decreases linearly for all impulses before ¢ until the instant t — 1. The input before t — 1 has no influence (zero weight). 
Thus, to determine the system response at t, we must assign a linearly decreasing weight to impulses occurring before t, as shown in Fig. 2.14b. 
This weighting function is precisely the function h(t — T). The system response at t is then determined not by the input x(T) but by the weighted 
input x(T)h(t — T), and the summation of all these weighted inputs is the convolution integral. 


2.4-3 Interconnected Systems 


A larger, more complex system can often be viewed as the interconnection of several smaller subsystems, each of which is easier to characterize. 
Knowing the characterizations of these subsystems, it becomes simpler to analyze such large systems. We shall consider here two basic 
interconnections, cascade and parallel. Figure 2.15a shows S; and Sz, two LTIC subsystems connected in parallel, and Fig. 2.155 shows the same 
two systems connected in cascade. 
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Figure 2.15: Interconnected systems. 


In Fig. 2.15a, the device depicted by the symbol 2 inside a circle represents an adder, which adds signals at its inputs. Also the junction from which 
two (or more) branches radiate out is called the pickoff node. Every branch that radiates out from the pickoff node carries the same signal (the signal 
at the junction). In Fig. 2.15a, for instance, the junction at which the input is applied is a pickoff node from which two branches radiate out, each of 
which carries the input signal at the node. 


Let the impulse response of S; and Sz be hy (ft) and ho(t), respectively. Further assume that interconnecting these systems, as shown in Fig. 2.15, 
does not load them. This means that the impulse response of either of these systems remains unchanged whether observed when these systems are 
unconnected or when they are interconnected. 


To find hp(t), the impulse response of the parallel system Sp in Fig. 2.15a, we apply an impulse at the input of S,. This results in the signal 8(t) at 
the inputs of S; and So, leading to their outputs h,(t) and ho(t), respectively. These signals are added by the adder to yield h, (t) + h(t) as the 
output of Sp. Consequently 


h,(t) = hy(t) + holt) (2.43a) 


To find h(t), the impulse response of the cascade system S, in Fig. 2.15b, we apply the input 8(t) at the input of S., which is also the input to S4. 
Hence, the output of S is h4(t), which now acts as the input to Sp. The response of Sz to input h(t) is h4(t) * ho(t). Therefore 


he(t) = hy(t) * h(t) (2.43b) 


Because of commutative property of the convolution, it follows that interchanging the systems S; and So, as shown in Fig. 2.15c, results in the same 
impulse response h,(t)*h2(t). This means that when several LTIC systems are cascaded, the order of systems does not affect the impulse response 
of the composite system. In other words, linear operations, performed in cascade, commute. The order in which they are performed is not important, 
at least theoretically.[T] 


We shall give here another interesting application of the commutative property of LTIC systems. Figure 2.15d shows a cascade of two LTIC systems: 
a system S with impulse response h(t), followed by an ideal integrator. Figure 2.15e shows a cascade of the same two systems in reverse order; an 
ideal integrator followed by S. In Fig. 2.15d, if the input x(t) to S yields the output y(t), then the output of the system 2.15d is the integral of y(t). In 
Fig. 2.15e, the output of the integrator is the integral of x(t). The output in Fig. 2.15e is identical to the output in Fig. 2.15d. Hence, it follows that if 
an LTIC system response to input x(t) is y(t), then the response of the same system to integral of x(t) is the integral of y(t). In other words, 


if x(t) => y(t) 
t i 
then / x(t)dr = | y(t)dr (2.44a) 


Replacing the ideal integrator with an ideal differentiator in Fig. 2.15d and 2.15e, and following a similar argument, we conclude that 


if x(t) ==> y(t) 
dx(t) dy(t) 
— 
dt dt 
If we let x(t) = 8(f) and y(t) = A(t) in Eq. (2.44a), we find that g(t), the unit step response of an LTIC system with impulse h(t), is given by 


then 


(2.44b) 


ee) = | h(t)dt (2.44c) 


We can also show that the system response to I(Nis dh(t)/dt. These results can be extended to other singularity functions. For example, the unit 
ramp response of an LTIC system is the integral of its unit step response, and so on. 


INVERSE SYSTEMS 
In Fig. 2.15b, if S; and Sp are inverse systems with impulse response h(t and h,(t), respectively, then the impulse response of the cascade of these 


systems is h(t) * h,(t). But, the cascade of a system with its inverse is an identity system, whose output is the same as the input. In other words, the 
unit impulse response of the cascade of inverse systems is also an unit impulse 5(f). Hence 


A(t) ehi(t) = 3) (2.45) 


We shall give an interesting application of the commutivity property. As seen from Eq. (2.45), a cascade of inverse systems is an identity system. 
Moreover, in a cascade of several LTIC subsystems, changing the order of the subsystems in any manner does not affect the impulse response of 
the cascade system. Using these facts, we observe that the two systems, shown in Fig. 2.15f, are equivalent. We can compute the response of the 


cascade system on the right-hand side, by computing the response of the system inside the dotted box to the input X(t), The impulse response of 
the dotted box is g(t), the integral of h(t), as given in Eq. (2.44c). Hence, it follows that 


y(t) = x(t) # h(t) = X(t) * g(t) (2.46) 


Recall that g(t) is the unit step response of the system. Hence, an LTIC response can also be obtained as a convolution of x(t) (the derivative of the 
input) with the unit step response of the system. This result can be readily extended to higher derivatives of the input. An LTIC system response is 
the convolution of the nth derivative of the input with the nth integral of the impulse response. 


2.4-4 A Very Special Function for LTIC Systems: The Everlasting Exponential eS‘ 


There is a very special connection of LTIC systems with the everlasting exponential function e®!, where s is a complex variable, in general. We now 


show that the LTIC system's (zero-state) response to everlasting exponential input e* is also the same everlasting exponential (within a multiplicative 
constant). Moreover, no other function can make the same claim. Such an input for which the system response is also of the same form is called the 
charcteristic function (also eigenfunction) of the system. Because a sinusoid is a form of exponential (s = +/w), everlasting sinusoid is also a 
characteristic function of an LTIC system. Note that we are talking here of an everlasting exponential (or sinusoid), which starts at tf = — oo 


If h(t) is the system's unit impulse response, then system response y(t) to an everlasting exponential eS is given by 
y(t) = h(t) xe" 


- / h(t)? dr 
nae 


=f h(t)e dr 


oo 


The integral on the right-hand side is a function of a complex variable s. Let us denote it by H(s), which is also complex, in general. Thus 


y(t) = H(s)e" (2.47) 
where 
oD 
H(s) -/ A(r)e"*" dt (2.48) 


Equation (2.47) is valid only for the values of s for which H(s) exists, that is, if [°_ . h(t)e 5" dt exists (or converges). The region in the s plane for 


which this integral converges is called the region of convergence for H(s). Further elaboration of the region of convergence is presented in Chapter 
4. 


Note that H(s) is a constant for a given s. Thus, the input and the output are the same (within a multiplicative constant) for the everlasting 
exponential signal. 


H(s), which is called the transfer function of the system, is a function of complex variable s. An alternate definition of the transfer function H(s) of an 
LTIC system, as seen from Eq. (2.47), is 


output signal 
fiji. (2.49) 


input signal input=everlasting exponential 


The transfer function is defined for, and is meaningful to, LTIC systems only. It does not exist for nonlinear or time-varying systems in general. 


We repeat again that in this discussion we are talking of the everlasting exponential, which starts at f= — oo, not the causal exponential etu(t), 
which starts at t = 0. 


For a system specified by Eq. (2.1), the transfer function is given by 


P(s) 
H(s) = — 2.50 
* QO(s) ee) 


This follows readily by considering an everlasting input x(t) = eS. According to Eq. (2.47), the output is y(t) = H(s)e*!. Substitution of this x(t) and 
y(t) in Eq. (2.1) yields 
H(s)[Q(D)e"] = P(D)e" 
Moreover 
tT ofl 
De = = se"! 
dt’ 


Hence 


P(D)e" = P(s)e" and O(D)e" = O(s)e" 


Consequently, 


EXERCISE E2.14 
Show that the transfer function of an ideal integrator is H(s) = 1/s and that of an ideal differentiator is H(s) = s. Find the answer in two ways: using 
Eq. (2.48) and Eq. (2.50). [Hint: Find A(t) for the ideal integrator and differentiator. You also may need to use the result in Prob. 1.4-9.] 


A FUNDAMENTAL PROPERTY OF LTI SYSTEMS 
We can show that Eq. (2.47) is a fundamental property of LTI systems and it follows directly as a consequence of linearity and time invariance. To 
show this let us assume that the response of an LTI system to an everlasting exponential et ig y(s, t). If we define 
y(s, t) 
H(s,t) = - 


et 


then 
y(s,t) = H(s, 0) e&* 


Because of the time-invariance property, the system response to input es(t—7) jg H(s, t—T) eslf—1) that is, 
y(s,t-—T)= H(s,t-—T)e-” (2.51) 


The delayed input es(t—T) represents the input est multiplied by a constant eS! Hence, according to the linearity property, the system response to 
es(f-T) must be y(s, t) e787. Hence 
y(s,t—T) = y(s, the? 

= H(s,t)e@-) 


Comparison of this result with Eq. (2.51) shows that 
H(s,t) = H(s,t —T) for all T 


This means H(s, t) is independent of ft, and we can express H(s, t) = H(s). Hence 
y(s, t) = H(s) e* 
2.4-5 Total Response 


The total response of a linear system can be expressed as the sum of its zero-input and zero-state components: 
N 
total response = pS cet + x(t) # A(t) 
k=1 


N / zero-stale component 


zero-inpul component 
assuming distinct roots. For repeated roots, the zero-input component should be appropriately modified. 


For the series RLC circuit in Example 2.2 with the input x(t) = 10.tu(t) and the initial conditions y(0°) = 0, v,(0°) = 5, we determined the zero-input 


component in Example 2.1a [Eq. (2.11c)]. We found the zero-state component in Example 2.6. From the results in Examples 2.1a and 2.6, we 
obtain 


total current = (—Se~’ + Se~™) + (—Se' + 20e-” — 15e~ 
nd 


zero-tapul Carrent sero-atale currest 


Figure 2.16a shows the zero-input, zero-state, and total responses. 


Figure 2.16: Total response and its components. 


NATURAL AND FORCED RESPONSE 


For the RLC circuit in Example 2.2, the characteristic modes were found to be e' and e2!. As we expected, the zero-input response is composed 
exclusively of characteristic modes. Note, however, that even the zero-state response [Eq. (2.52a)] contains characteristic mode terms. This 
observation is generally true of LTIC systems. We can now lump together all the characteristic mode terms in the total response, giving us a 
component known as the natural response y,(t). The remainder, consisting entirely of noncharacteristic mode terms, is known as the forced response 
Yq(t). The total response of the RLC circuit in Example 2.2 can be expressed in terms of natural and forced components by regrouping the terms in 
Eq. (2.52a) as 


total current = (—10e™' + 25e™™) + (—1Se™™) r>0 (2.52b) 
a —/ 
eatural response y_{s) forced response yy (s) 


Figure 2.16b shows the natural, forced, and total responses. 


[tin deriving this result we have assumed a time-invariant system. If the system is time varying, then the system response to the input 6(t — nAT) 
cannot be expressed as h(t — nAT) but instead has the form h(t, nAT). Use of this form modifies Eq. (2.29) to 


y(t) = Be aear ny ~nAr)At 


- | x(dAC —t)dt (2.29) 


a 


where h(t, T) is the system response at instant f to a unit impulse input located at T. 
[tlStrange that religious establishments are not agitating for compulsory "convolution education" in schools and colleges! 


[tlThe late Prof. S. J. Mason, the inventor of signal flow graph techniques, used to tell a story of a student frustrated with the impulse function. The 
student said, "The unit impulse is a thing that is so small you can't see it, except at one place (the origin), where it is so big you can't see it. In other 


words, you can't see it at all; at least | can't!"[2] 
[t]Mason, S. J. Electronic Circuits, Signals, and Systems. Wiley, New York, 1960. 


[tlChange of order, however, could affect performance because of physical limitations and sensitivities to changes in the subsystems involved. 


2.5 CLASSICAL SOLUTION OF DIFFERENTIAL EQUATIONS 


In the classical method we solve differential equation to find the natural and forced components rather than the zero-input and zero-state components 
of the response. Although this method is relatively simple compared with the method discussed so far, as we shall see, it also has several glaring 
drawbacks. 


As Section 2.4-5 showed, when all the characteristic mode terms of the total system response are lumped together, they form the system's natural 
response yp (t) (also known as the homogeneous solution or complementary solution). The remaining portion of the response consists entirely of 


noncharacteristic mode terms and is called the system's forced response y(t) (also known as the particular solution). Equation (2.52b) showed these 
two components for the loop current in the RLC circuit of Fig. 2.1a. 


The total system response is y(t) = Ynt) + Yo(t). Since y(t) must satisfy the system equation [Eq. (2.1)], 
Q(D)[yn(t) + yo] = P(D)x(t) 


or 
QO(D)y,.(t) + O(D)y6(t) = P(D)x(t) 
But y,,(t) is composed entirely of characteristic modes. Therefore 


so that 


Q(D)ye(t) = P(D)x(t) (2.53) 


The natural response, being a linear combination of the system's characteristic modes, has the same form as that of the zero-input response; only its 
arbitrary constants are different. These constants are determined from auxiliary conditions, as explained later. We shall now discuss a method of 
determining the forced response. 


2.5-1 Forced Response: The Method of Undetermined Coefficients 


It is a relatively simple task to determine yor), the forced response of an LTIC system, when the input x(t) is such that it yields only a finite number 
of independent derivatives. Inputs having the form e° or tf" fall into this category. For example, the repeated differentiation of eS! yields the same form 
as this input; that is, eft, Similarly, the repeated differentiation of t” yields only r independent derivatives. The forced response to such an input can be 


expressed as a linear combination of the input and its independent derivatives. Consider, for example, the input has af? + bt + c. The successive 
derivatives of this input are 2at + b and 2a. In this case, the input has only two independent derivatives. Therefore, the forced response can be 
assumed to be a linear combination of x(t) and its two derivatives. The suitable form for y(t) in this case is, therefore 


a 
Yo(t) = Bot” + Bit + Bo 
The undetermined coefficients Bg,B; and Bz are determined by substituting this expression for Yo(tin Eq. (2.53) 
O(D)ye(t) = P(D)x(t) 
and then equating coefficients of similar terms on both sides of the resulting expression. 


Although this method can be used only for inputs with a finite number of derivatives, this class of inputs includes a wide variety of the most 
commonly encountered signals in practice. Table 2.2 shows a variety of such inputs and the form of the forced response corresponding to each 
input. We shall demonstrate this procedure with an example. 


Table 2.2: Forced Response 
= Open table as spreadsheet 


Input x(t) Forced Response 
eS C 2 2(i= 1,2,...,N) Best 
et C=) pet 


No. 

1 

2 
[S| 
— 

5 


k (a constant) B (a constant) 
cos (wt + 8) Bcos (wt + 8) 
(f + apqt@' +... + at + ag)e%) (Byt" + Byatt! +... + Bt + Boje“) 


Note: By definition, y(t) cannot have any characteristic mode terms. If any term appearing in the right-hand column for the forced response is 


also a characteristic mode of the system, the correct form of the forced response must be modified to y(t), where jis the smallest possible 
integer that can be used and still can prevent tg (t) from having a characteristic mode term. For example, when the input is eS! the forced 


response (right-hand column) has the form Be, But if eS! happens to be a characteristic mode of the system, the correct form of the forced 


response is Bte% (see pair 2). If teS‘ also happens to be a characteristic mode of the system, the correct form of the forced response is Bt7eS!, 
and so on. 


EXAMPLE 2.10 
Solve the differential equation 


(D? + 3D + 2)y(t) = Dx(t) 


if the input 
x(t) =P 4+5t4+3 


and the initial conditions are y(0*) = 2 and y(0*) = 3. 


The characteristic polynomial of the system is 


743042 = (A+ 1)(A 42) 


Therefore, the characteristic modes are et and e2!. The natural response is then a linear combination of these modes, so that 


y,(t) = Kye"! + K,e~™ t>0 


Here the arbitrary constants K, and Kz must be determined from the system's initial conditions. 


The forced response to the input t? + 5f + 3, according to Table 2.2 (pair 5 with € = 0), is 
yo(t) = Brat? + Bit + Bo 
Moreover, Yo(t) satisfies the system equation [Eq. (2.53)]; that is, 

(D? + 3D + 2)ye(t) = Dx(t) (2.54) 


Now 


d 
Dyg{t) = 7 Pat + Bit + Bo) = 2Bot + B, 


d? 

me 0 MP 2 pi 
D'yo(t) = F5(Bat! + Bil + Bo) = 262 
and 

d 

Dx(t) = al +5t+3)=2r+5 
Substituting these results in Eq. (2.54) yields 
2B. + 3(2Bot + Bi) + 2(Bot? + Bil + Bo) = 21 +5 
or 
2Bot? + (2B; + 6B2)t + (2B) +38; +262) = 2 +5 


Equating coefficients of similar powers on both sides of this expression yields 


2B, = 0 
2B; + 6B, = 2 
2Bo + 3B; + 2B. = 5 


Solution of these three simultaneous equations yields By = 1, By = 1, and Bo = 0. Therefore 


yo(t) =t+1 t>0 


The total system response y(t) is the sum of the natural and forced solutions. Therefore 
y(t) = yn (t) + Yo(t) 


= Kie" + Koe" +141 1>0 


so that 
y(t) = —K,e' —2K2e°7 +1 


Setting t = 0 and substituting y(0) = 2 y(0) = 3 in these equations, we have 
2=K,+K2+1 


3 = —-Ki —2K2+1 
The solution of these two simultaneous equations is K, = 4 and Kp = —3. Therefore 


y(t) = 4e* —3e "4141 t>0 
COMMENTS ON INTIAL CONDITIONS 


In the classical method, the initial conditions are required at tf = 0*. The reason is that because at f = 07, only the zero-input component exists, and 


the initial conditions at t= 0” can be applied to the zero-input component only. In the classical method, the zero-input and zero-state components 


cannot be separated Consequently, the initial conditions must be applied to the total response, which begins at t = 0*. 


EXERCISE E2.15 


An LTIC system is specified by the equation 
(D+ 5D + 6)¥(f) = (D+ Ix(f) 


The input is x(t) = 62. Find the following: 


a. The forced response y(t) 


b. The total response y(t) if the initial conditions are y(0*) = 25/18 and y(0*) = —2/3 


Answers 


a veH=P+t—-H 


b. Wt) =S5e-% —3e * + (? +34 - 2) 


THE EXPONENTIAL INPUT eS) 


The exponential signal is the most important signal in the study of LTIC systems. Interestingly, the forced response for an exponential input signal 
turns out to be very simple. From Table 2.2 we see that the forced response for the input eS‘ has the form BeS!. We now show that B = Q(tVP(T).1] 


To determine the constant B, we substitute yet in the system equation [Eq. (2.53)] to obtain 


O(D)[Be*'] = P(D)e* 
Now observe that 
d 
De™! = —(e*') = ot 
e ae )=e 
2 


2 ce > 
D*e*! _ qate”) = cet! 


De® _ te’! 
Consequently 
O(D)e = O(cye" sand Ss P(D Je = P(e )e* 


Therefore, Eq. (2.53) becomes 
BO(e)e* = P(eye* 


and 
Thus, for the input x(t) = eSu(t), the forced response is given by 
yth=A(Qe 120 (2.55) 
where 
H(g)= o (2.56) 


This is an interesting and significant result. It states that for an exponential input e° the forced response y(t) is the same exponential multiplied by 


H(C) = P(CVQ(T). The total system response y(t) to an exponential input e%! is then given by! 


N 
y(t) = >> Kye" + H(e)e* (2.57) 
j=! 
where the arbitrary constants Kj, K2,..., Kay are determined from auxiliary conditions. The form of Eq. (2.57) assumes N distinct roots. If the roots are 
not distinct, proper form of modes should be used. 


Recall that the exponential signal includes a large variety of signals, such as a constant (C = 0), a sinusoid (C = + jw), and an exponentially growing 
or decaying sinusoid (C = o + jw). Let us consider the forced response for some of these cases. 


THE CONSTANT INPUT x(t) = C 
Because C = 2°", the constant input is a special case of the exponential input CeS with C = 0. The forced response to this input is then given by 
yl) =CH(o)e" ~— with =0 
= CH(0) (2.58) 
THE EXPONENTIAL INPUT e/t 
Here TC = jw and 
ye(t) = H(ja)e!” (2.59) 


THE SINUSOIDA INPUT x(t) = cos wt 
We know that the forced response for the input e*/“ is H(+jw)e*™. Since cos w; = (e/”! + e/2, the forced response to cos wt is 


yo(t) = 1LH(ja)ei” + H(—jw)e i] 


Because the two terms on the right-hand side are conjugates, 
yy(t) = Re[H(ja)e™] 

But 

H(jw) = |H(ja)|ei*"9~) 


so that 


ye(t) = Re{|H(jo)|e/ 44d) 
= |H(jm)| cos [ot + 4H(jo)) (2.60) 
This result can be generalized for the input x(t) = cos (wf + 0). The forced response in this case is 
ya(t) = |H(jo)| cos [ot + 0 + LH(jo)] (261) 
EXAMPLE 2.11 


Solve the differential equation 


(D? + 3D + 2)y(t) = Dx(t) 
if the initial conditions are y(0*) = 2 and Y(O" ) = 2 and y(O") = 3 and the input is 
a. 1063 


b. 5 


c. e 2t 


d. 10 cos(3t + 30°) 
According to Example 2.10, the natural response for this case is 
Ya(t) = Kie! + Kre™ 
For this case 
P(g) s 
H(¢) = —— = = 
QO) +3642 
a. For input x(t) = 10e°'¢ = —3, and 


=) =3 
yet) = 10H(—3)e™" = 10] 


= -M 
— | gp * = 1507 > 
wp oga ‘ f20 


The total solution (the sum of the forced and the natural response) is 
y(t) = Kye! + Koe™ — 15e°* t>0 
and 


y(t) = —Ky,e' —2Kxe"™+4+45e" 120 


The initial conditions are y(0*) = 2 and y(0") = 3. Setting t = 0 in the foregoing equations and then substituting the initial conditions 
yields 
K, + K,-—15=2 and —K, —2K,+45 =3 


Solution of these equations yields K; = —8 and Kg = 25. Therefore 


y(t) = —8e~' + 25e~-* — 15e-* t>0 


b. For input x (t) = 5 = 5e°!, © = 0, and 
yg(t) = 5H(0) =0 t>0 


The complete solution is Ky et+ Kye 2! + 2te — t. Using the initial conditions, we determine K; and Ko as in part (a). 


c. Here € = —2, which is also a characteristic root of the system. Hence (see pair 2, Table 2.2, or the note at the bottom of the table). 
— 
ye(t) = Bre 


To find B, we substitute yo ,(t) in the system equation to obtain 


(D? + 3D +2)y4(t) = Dx(t) 


or 
(D? + 3D + 2)[pte-™| = De~™ 


But 
D{Bte~™] = BU —201)e~™ 


D*[Bte-™] = 4B (t — 1)e"” 


De = —2e% 
Consequently 
B(4t —44+3 —61+2t)e-" = —2e 
or 
—pe™ = —2e 


Therefore, B = 2 so that 


ye(t) = 2te~*" 


The complete solution is Ket + Kye 24, Using the initial conditions, we determine K; and Ko as in part (a). 


d. For the input x(t) = 10cos (3° + 30°), the forced response [see Eq. (2.61)] is 
Yo(t) = 10| H(j3)| cos[3r + 30° + 2H(j3)] 


where 
; ; ; 6 Pe eS 
a a Aker ere 
QOUj3) = (f3)? +3173) +2 -7+ j9 130 
Therefore 


|H(j3)| = 0.263 
£H(j3) = —37.9° 


and 


ys(t) = 10(0.263) cos (31 + 30° — 37.9°) = 2.63 cos (31 — 7.9") 
The complete solution is Ky el + Kye 2t + 2.63cos (3t — 7.9°). We then use the initial conditions to determine K; and Ko as in part (a). 


EXAMPLE 2.12 — oe 7 7 - 
Use the classical method to find the loop current y(t) in the RLC circuit of Example 2.2 (Fig. 2.1) if the input voltage x(t) = 10,3! and the initial 


conditions are y(O") = 0 and u, (0°) = 5. 


The zero-input and zero-state responses for this problem are found in Examples 2.2 and 2.6, respectively. The natural and forced responses appear 


in Eq. (2.52b). Here we shall solve this problem by the classical method, which requires the initial conditions at t = 0*. These conditions, already 
found in Eq. (2.15), are 


y(0") =0 and s07>)'=5 
The loop equation for this system [see Example 2.2 or Eq. (1.55)] is 
(D? + 3D + 2)y(t) = Dx(t) 
The characteristic polynomial is A? + 3A + 2 = (A + 1)(A + 2) Therefore, the natural response is 
¥n(t) = Kye" + K»e~7! 
The forced response, already found in part (a) of Example 2.11, is 
y(t) = —15e-* 
The total response is 
, 
y(t) = Kie '+ Kre “ — 15e 


Differentiation of this equation yields 
. 4 
y(t) = —Kie' —2K.e™ + 45e™ 


ci 


Setting t = 0* and substituting y(0*) = 0, y(0*) = 5 in these equations yields 


0= K,+K2-15 K, = -10 
—> 

5 = —K, —2K,2+45 Ko = ‘25 

Therefore 


a 


y(t) = —10e' + 25e°” — 15e 


which agrees with the solution found earlier in Eq. (2.52b). 


COMPUTER EXAMPLE C2.4 
Solve the differential equation 


(D? + 3D + 2)y() = x0) 


using the input x(t) = 5t + 3 and initial conditions yg(0) = 2 and yo(0) = 3. 
>>y = dsolve ('D2y+3*Dy+2* y=5*t+3"', y(O)=2', "Dy(0)=3', 't"); 

>>disp (['y(t) = (',char(y), ')u(t) ' ]); 

y(t) = (-9/4+5/2*t+9*exp (-t) -19/4*exp (-2*t) )u(t) 

Therefore, 


y(t) = (—3 + 314+ 9e! — Be Ju) 

ASSESSMENT OF THE CLASSICAL METHOD 

The development in this section shows that the classical method is relatively simple compared with the method of finding the response as a sum of 
the zero-input and zero-state components. Unfortunately, the classical method has a serious drawback because it yields the total response, which 
cannot be separated into components arising from the internal conditions and the external input. In the study of systems it is important to be able to 
express the system response to an input x(t) as an explicit function of x(t). This is not possible in the classical method. Moreover, the classical 


method is restricted to a certain class of inputs; it cannot be applied to any input. Another minor problem is that because the classical method yields 
total response, the auxiliary conditions must be on the total response which exists only for t > 0*. In practice we are most likely to know the 
conditions at t = 0” (before the input is applied). Therefore, we need to derive a new set of auxiliary conditions at t = 0* from the known conditions at 


t=0. 
If we must solve a particular linear differential equation or find a response of a particular LTIC system, the classical method may be the best. In the 
theoretical study of linear systems, however, the classical method is not so valuable. 


Caution We have shown in Eq. (2.52a) that the total response of an LTI system can be expressed as a sum of the zero-input and the zero- 
state components. In Eq. (2.52b), we showed that the same response can also be expressed as a sum of the natural and the forced 
components. We have also seen that generally the zero-input response is not the same as the natural response (although both are 
made of natural modes). Similarly, the zero-state response is not the same as the forced response. Unfortunately, such erroneous 
claims are often encountered in the literature. 


[tl This result is valid only if € is not a characteristic root of the system. 


[4]Observe the closeness of Eqs. (2.57) and (2.47). Why is there a difference between the two equations? Equation (2.47) is the response to an 
exponential that started at — oo, while Eq. (2.57) is the response to an exponential that starts at f= 0. As t — o, Eq. (2.57) approaches Eq. (2.47). In 
Eq. (2.47), the term y,,(t), which starts at t = — oo, has already decayed at t = 0, and hence, is missing. 


2.6 SYSTEM STABILITY 


To understand the intuitive basis for the BIBO (bounded-input/bounded-output) stability of a system introduced in Section 1.7, let us examine the 
stability concept as applied to a right circular cone. Such a cone can be made to stand forever on its circular base, on its apex, or on its side. For this 
reason, these three states of the cone are said to be equilibrium states. Qualitatively, however, the three states show very different behavior. If the 
cone, standing on its circular base, were to be disturbed slightly and then left to itself, it would eventually return to its original equilibrium position. In 
such a case, the cone is said to be in stable equilibrium. In contrast, if the cone stands on its apex, then the slightest disturbance will cause the cone 
to move farther and farther away from its equilibrium state. The cone in this case is said to be in an unstable equilibrium. The cone lying on its side, if 
disturbed, will neither go back to the original state nor continue to move farther away from the original state. Thus it is said to be in a neutral 
equilibrium. Clearly, when a system is in stable equilibrium, application of a small disturbance (input) produces a small response. In contrast, when 
the system is in unstable equilibrium, even a minuscule disturbance (input) produces an unbounded response. BIBO stability definition can be 


understood in the light of this concept. If every bounded input produces bounded output, the system is (BIBO) stable.!T] In contrast, if even one 
bounded input results in unbounded response, the system is (BIBO) unstable. 


For an LTIC system 


y(t) = A(t) * x(t) 


-/ A(t)x(t — t)dt (2.62) 
Therefore 
oo 
|y(t)| <[ JA(r)||x(t — t)| dt 


Moreover, if x(t) is bounded, then |(x — T)t < K1 < «, and 


oO 
|v(t)| < K, | |h(r)| dr (2.63) 


oo 


Hence for BIBO stability 


i |h(t)|dt < co (2.64) 


mo 


This is a sufficient condition for BIBO stability. We can show that this is also a necessary condition (see Prob. 2.6-4). Therefore, for an LTIC system, 
if its impulse response h(t) is absolutely integrale, the system is (BIBO) stable. Otherwise it is (BIBO) unstable. In addition, we shall show in Chapter 
4 that a necessary (but not sufficient) condition for an LTIC system described by Eq. (2.1) to be BIBO stable is M < N. If M> N, the system is 
unstable. This is one of the reasons to avoid systems with M > N. 


Because the BIBO stability of a system can be ascertained by measurements at the external terminals (input and output), this is an external stability 
criterion. It is no coincidence that the BIBO criterion in (2.64) is in terms of the impulse response, which is an external description of the system. 


As observed in Section 1.9, the internal behavior of a system is not always ascertainable from the external terminals. Therefore, the external (BIBO) 
stability may not be correct indication of the internal stability. Indeed, some systems that appear stable by the BIBO criterion may be internally 
unstable. This is like a room inside a house on fire: no trace of fire is visible from outside, but the entire house will be burned to ashes. 


The BIBO stability is meaningful only for systems in which the internal and the external description are equivalent (controllable and observable 
systems). Fortunately, most practical systems fall into this category, and whenever we apply this criterion, we implicitly assume that the system in fact 
belongs to this category. The internal stability is all-inclusive, and the external stability can always be determined from the internal stability. For this 


reason, we now investigate the internal stability criterion. 


2.6-1 Internal (Asymptotic) Stability 


Because of the great variety of possible system behaviors, there are several definitions of internal stability in the literature. Here we shall consider a 
definition that is suitable for causal, linear, time-invariant (LTI) systems. 


If, in the absence of an external input, a system remains in a particular state (or condition) indefinitely, then that state is said to be an equilibrium 
state of the system. For an LTI system, zero state, in which all initial conditions are zero, is an equilibrium state. Now suppose an LTI system is in 
zero state and we change this state by creating small nonzero initial conditions (small disturbance). These initial conditions will generate signals 
consisting of characteristic modes in the system. By analogy with the cone, if the system is stable it should eventually return to zero state. In other 
words, when left to itself, every mode in a stable system arising as a result of nonzero initial conditions should approach 0 as t — oo. However, if 
even one of the modes grows with time, the system will never return to zero state, and the system would be identified as unstable. In the borderline 
case, some modes neither decay to zero nor grow indefinitely, while all the remaining modes decay to zero. This case is like the neutral equilibrium 
in the cone. Such a system is said to be marginally stable. The internal stability is also called asymptotic stability or stability in the sense of 
Lyapunov. 


For a system characterized by Eq. (2.1), we can restate the internal stability criterion in terms of the location of the N characteristic roots Aj, ?9,..., 


Xn of the system in a complex plane. The characteristic modes are of the form ed! or t eAxt, Location of roots in the complex plane and the 


corresponding modes are shown in Fig. 2.17. These modes — 0 as t — oo if Re Ax, < 0 In contrast, the modes — oo* oo if Ra Axso [t] Hence, a 

system is (asymptotically) stable if all its characteristic roots lie in the LHP, that is, if Re A, <0 for all k. If even a single characteristic root lies in the 
RHP, the system is (asymptotically) unstable. Modes due to roots on the imaginary axis (A = +/wg) are of the form e*/“ol Hence, if some roots are 
on the imaginary axis, and all the remaining roots are in the LHP, the system is marginally stable (assuming that the roots on the imaginary axis are 


not repeated). If the imaginary axis roots are repeated, the characteristic modes are of the form ft" et/&xt which do grow with time indefinitely. 
Hence, the system is unstable. Figure 2.18 shows stability regions in the complex plane. 
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Figure 2.17: Location of characteristic roots and the corresponding characteristic modes. 
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Figure 2.18: Characteristic roots location and system stability. 
To summarize: 


1. An LTIC system is asymptotically stable if, and only if, all the characteristic roots are in the LHP. The roots may be simple (unrepeated) 
or repeated. 


2. An LTIC system is unstable if, and only if, one or both of the following conditions exist: (i) at least one root is in the RHP; (ii) there are 
repeated roots on the imaginary axis. 


3. An LTIC system is marginally stable if, and only if, there are no roots in the RHP, and there are some unrepeated roots on the 
imaginary axis. 


2.6-2 Relationship Between BIBO and Asymptotic Stability 


The external stability is determined by applying the external input with zero initial conditions, while the internal stability is determined by applying the 
nonzero initial conditions and no external input. This is why these stabilities are also called the zero-state stability and the zero-input stability, 
respectively. 


Recall that h(t), the impulse response of an LTIC system, is a linear combination of the system characteristic modes. For an LTIC system, specified 
by Eq. (2.1), we can readily show that when a characteristic root A, is in the LHP, the corresponding mode ehxt ig absolutely integrable. In contrast, if 


Ax is in the RHP or on the imaginary axis, eMk! is not absolutely integrable.!T] This means that an asymptotically stable system is BIBO stable. 


Moreover, a marginally stable or asymptotically unstable system is BIBO unstable. The converse is not necessarily true; that is, BIBO stability does 
not necessarily inform us about the internal stability of the system. For instance, if a system is uncontrollable and/or unobservable, some modes of 


the system are invisible and/or uncontrollable from the external terminals.!$] Hence, the stability picture portrayed by the external description is of 
questionable value. BIBO (external) stability cannot assure internal (asymptotic) stability, as the following example shows. 


EXAMPLE 2.13 

An LTID systems consists of two subsystems S; and S92 in cascade (Fig. 2.19). The impulse response of these systems are h,(t) and ho(t), 
respectively, given by 

hi(t)=6(t)-—2e‘u(t) and = y(t) = e'u(e) 


x) | vit} 


Figure 2.19: BIBO and asymptotic stability. 


The composite system impulse response h(t) is given by 
h(t) = hy (t) hat) = hat) eh, (2) = u(t) * [8(1) — 2e'u(t)] 


e'-—e' 
2 
=e u(t) 


If the composite cascade system were to be enclosed in a black box with only the input and the output terminals accessible, any measurement from 
these external terminals would show that the impulse response of the system is etu(t), without any hint of the dangerously unstable system the 
system is harboring within. 


The composite system is BIBO stable because its impulse response, etu(t), is absolutely integrable. Observe, however, the subsystem Sy has a 


characteristic root 1, which lies in the RHP. Hence, S2 is asymptotically unstable. Eventually, S2 will burn out (or saturate) because of the 
unbounded characteristic response generated by intended or unintended initial conditions, no matter how small. We shall show in Example 10.11 that 
this composite system is observable, but not controllable. If the positions of S; and Sz were interchanged Sz followed by S,), the system is still 


BIBO stable, but asymptotically unstable. In this case, the analysis in Example 10.11 shows that the composite system is controllable, but not 
observable. 


This example shows that BIBO stability does not always imply asymptotic stability. However, asyptotic stability always implies BIBO stability 


Fortunately, uncontrollable and/or unobservable systems are not commonly observed in practice. Henceforth, in determining system stability, we shall 
assume that unless otherwise mentioned, the internal and the external descriptions of a system are equivalent, implying that the system is 
controllable and observable 


EXAMPLE 2.14 


Investigate the asymptotic and the BIBO stability of LTIC system described by the following equations, assuming that the equations are internal 
system description. 


a. (D+ 1)(D2 + 4D + 8)y(t) = (D-3)x(t) 

b. (D — 1)(D2 + 4D + 8)y(t) = (D+2)x(t) 

c. (D + 2)(D2 + 4)y(t) = (D2 + D + 1)x(t) 

d. (D + 1)(D? + 4)y(t) = (D2 + 2D + 8)x(t) 
The characteristic polynomials of these systems are 


a. (A+ 1)(A2 + 4A + 8) =(A+1)(A +2 — j2)(A + 2 + j2) 


b. (N— 1)(A2 + 4A + 8) = (A — 1)(A + 2 — j2)(A + 2 + 2) 
c. (A + 2)(A2 + 4) = (A + 2)(A — j2)(A + j2) 
d. (A + 1)(A? + 4)? = (A + 2)(A — j2)2(A + 2)? 
Consequently, the characteristic roots of the systems are (see Fig. 2.20): 
a. —1,-24/2 
b. 1,-2 4/2 
c. —2 4/2 
1,—4/2,4/2 
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Figure 2.20: Location of characteristic roots for the systeiha: 


System (a) is asymptotically stable (all roots in LHP), system (b) is unstable (one root in RHP), system (c) is marginally stable (unrepeated roots on 
imaginary axis) and no roots in RHP, and system (d) is unstable (repeated roots on the imaginary axis). BIBO stability is readily determined from the 
asymptotic stability. System (a) is BIBO stable, system (b) is BIBO unstable, system (c) is BIBO unstable, and system (d) is BIBO unstable. We have 
assumed that these systems are controllable and observable. 


EXERCISE E2.16 


For each of the systems specified by the equations that follow, plot its characteristic roots in the complex plane and 
determine whether it is asymptotically stable, marginally stable, or unstable, assuming that the equations describe its - 
internal system. Also, determine BIBO stability for each system. 


a. D(D + 2)y(t) = 3x(t) 
b. D*(D + 3)y(t) = (D + 5)x(t) 

c. (D+ 1)(D + 2)y(t) = (2D + 3)x(t) 

d. (D? + 1)(D2 + 9)y(t) = (D2 + 2D + 4)x(t) 
e. (D+ 1)(D2 —4D + 9)y(t) = (D + 7)x(t) 


Answers 


a. Marginally stable, but BIBO unstable 
b. Unstable in both senses 

c. Stable in both senses 

d. Marginally stable, but BIBO unstable 


e. Unstable in both senses. 


IMPLICATIONS OF STABILITY 

All practical signal processing systems must be asymptotically stable. Unstable systems are useless from the viewpoint of signal processing because 
any set of intended or unintended initial conditions leads to an unbounded response that either destroys the system or (more likely) leads it to some 
saturation conditions that change the nature of the system. Even if the discernible initial conditions are zero, stray voltages or thermal noise signals 

generated within the system will act as initial conditions. Because of exponential growth of a mode or modes in unstable systems, a stray signal, no 
matter how small, will eventually cause an unbounded output. 


Marginally stable systems, though BIBO unstable, do have one important application in the oscillator, which is a system that generates a signal on its 
own without the application of an external input. Consequently, the oscillator output is a zero-input response. If such a response is to be a sinusoid 
of frequency Wo, the system should be marginally stable with characteristic roots at +j/wo. Thus, to design an oscillator of frequency Wo, we should 


pick a system with the characteristic polynomial (A — jwo)(A + jWo) + Mz = jWo2). A system described by the differential equation 


(D* + wy”) y(t) = x(t) (2.65) 


will do the job. However, practical oscillators are invariably realized using nonlinear systems. 


[tlThe system is assumed to be in zero state. 


[tl This may be seen from the fact that if « and B are the real and the imaginary parts of a root A, then 


: 0 a<O 
lim e = lim e!¢+/" = Jim e* ef?! = 
Ico Io ico oO a>dQ 


This conclusion is also valid for the terms of the form te‘, 


[tlConsider a mode of the form e4!, where \ = « + jB. Hence, e”! e*t and |e] = e"!. Therefore 


oo oO =| <0 
i. je“ u(t)| dt =| Odea a as 
bs 6 oO a>0 


This conclusion is also valid when the integrand is of the form \tkeMu(t)]. 


[3]kailath, T. Linear System. Prentice-Hall, Englewood Cliffs, NJ, 1980. 


2.7 INTUITIVE INSIGHTS INTO SYSTEM BEHAVIOR 


This section attempts to provide an understanding of what determines system behavior. Because of its intuitive nature, the discussion is more or less 
qualitative. We shall now show that the most important attributes of a system are its characteristic roots or characteristic modes because they 
determine not only the zero-input response but also the entire behavior of the system. 


2.7-1 Dependence of System Behavior on Characteristic Modes 


Recall that the zero-input response of a system consists of the system's characteristic modes. For a stable system, these characteristic modes decay 
exponentially and eventually vanish. This behavior may give the impression that these modes do not substantially affect system behavior in general 
and system response in particular. This impression is totally wrong! We shall now see that the system's characteristic modes leave their imprint on 
every aspect of the system behavior. We may compare the system's characteristic modes (or roots) to a seed that eventually dissolves in the 
ground; however, the plant that springs from it is totally determined by the seed. The imprint of the seed exists on every cell of the plant. 


To understand this interesting phenomenon, recall that the characteristic modes of a system are very special to that system because it can sustain 
these signals without the application of an external input. In other words, the system offers a free ride and ready access to these signals. Now 
imagine what would happen if we actually drove the system with an input having the form of a characteristic mode! We would expect the system to 
respond strongly (this is, in fact, the resonance phenomenon discussed later in this section). If the input is not exactly a characteristic mode but is 
close to such a mode, we would still expect the system response to be strong. However, if the input is very different from any of the characteristic 
modes, we would expect the system to respond poorly. We shall now show that these intuitive deductions are indeed true. 


fe ‘ext Ear Hed 


Tires ez cL tC, eens, 


Li en, 


CONICLIO eae Biarin3 


Intuition can cut the math jungle instantly! 


Although we have devised a measure of similarity of signals later, in Chapter 6, we shall take a simpler approach here. Let us restrict the system's 


inputs to exponentials of the form etl, where T is generally a complex number. The similarity of two exponential signals ec! and ec! will then be 
measured by the closeness of T and X. If the difference ¢ — A is small, the signals are similar; if C — A is large, the signals are dissimilar. 


Now consider a first-order system with a single characteristic mode et and the input eS! The impulse response of this system is then given by Ae* 
where the exact value of A is not important for this qualitative discussion. The system response y(t) is given by 
y(t) = A(t) * x(t) 

= Ae u(t) xe u(t) 


From the convolution table (Table 2.1), we obtain 


A . ; 
y(t) = ic rie" —e ult) (2.66) 


Clearly, if the input et is similar to eA, TC — Ais small and the system response is large. The closer the input x(t) to the characteristic mode, the 
stronger the system response. In contrast, if the input is very different from the natural mode, C — A is large and the system responds poorly. This is 
precisely what we set out to prove. 


We have proved the foregoing assertion for a single-mode (first-order) system. It can be generalized to an Nth-order system, which has N 
characteristic modes. The impulse response h(t) of such a system is a linear combination of its N modes. Therefore, if x(t) is similar to any one of the 
modes, the corresponding response will be high; if it is similar to none of the modes, the response will be small. Clearly, the characteristic modes are 
very influential in determining system response to a given input. 


It would be tempting to conclude on the basis of Eq. (2.66) that if the input is identical to the characteristic mode, so that € = A, then the response 
goes to infinity. Remember, however, that if € = A, the numerator on the right-hand side of Eq. (2.66) also goes to zero. We shall study this complex 
behavior (resonance phenomenon) later in this section. 


We now show that mere inspection of the impulse response h(t) (which is composed of characteristic modes) reveals a great deal about the system 
behavior. 


2.7-2 Response Time of a System: The System Time Constant 


Like human beings, systems have a certain response time. In other words, when an input (stimulus) is applied to a system, a certain amount of time 
elapses before the system fully responds to that input. This time lag or response time is called the system time constant. As we shall see, a system's 
time constant is equal to the width of its impulse response h(t). 


An input 8(t) to a system is instantaneous (zero duration), but its response h(t) has a duration Tp. Therefore, the system requires a time Tp to 
respond fully to this input, and we are justified in viewing T, as the system's response time or time constant. We arrive at the same conclusion via 
another argument. The output is a convolution of the input with h(t). If an input is a pulse of width T,, then the output pulse width is 7, + Tp 
according to the width property of convolution. 


This conclusion shows that the system requires T, seconds to respond fully to any input. The system time constant indicates how fast the system is. 


A system with a smaller time constant is a faster system that responds quickly to an input. A system with a relatively large time constant is a 
sluggish system that cannot respond well to rapidly varying signals. 


Strictly speaking, the duration of the impulse response h(t) is 0 because the characteristic modes approach zero asymptotically as t - oo. However, 
beyond some value of t, h(t) becomes negligible. It is therefore necessary to use some suitable measure of the impulse response's effective width. 


There is no single satisfactory definition of effective signal duration (or width) applicable to every situation. For the situation depicted in Fig. 2.21, a 
reasonable definition of the duration h(t) would be Ty, the width of the rectangular pulse h(t). This rectangular pulse h(t) has an area identical to that 


of h(t) and a height identical to that of h(t) at some suitable instant t = t,. In Fig. 2.21, tg is chosen as the instant at which A(t) is maximum. 


According to this definition, |] 
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Figure 2.21: Effective duration of an impulse response. 


Now if a system has a single mode 


h(t) = Ae“ u(t) 


with A negative and real, then h(t) is maximum at t = 0 with value h(0) = A. Therefore, according to Eq. (2.67), 


Lh <x l 
i= =| Ae“ dt = -—- (2.68) 
A Oo A 


Thus, the time constant in this case is simply the (negative of the) reciprocal of the system's characteristic root. For the multimode case, A(t) is a 
weighted sum of the system's characteristic modes, and T) is a weighted average of the time constants associated with the N modes of the system. 


2.7-3 Time Constant and Rise Time of a System 


Rise time of a system, defined as the time required for the unit step response to rise from 10% to 90% of its steady-state value, is an indication of 
the speed of response. |T] The system time constant may also be viewed from a perspective of rise time. The unit step response y(t) of a system is 
the convolution of u(t) with A(t). Let the impulse response h(t) be a rectangular pulse of width T}, as shown in Fig. 2.22. This assumption simplifies 
the discussion, yet gives satisfactory results for qualitative discussion. The result of this convolution is illustrated in Fig. 2.22. Note that the output 
does not rise from zero to a final value instantaneously as the input rises; instead, the output takes 7}, seconds to accomplish this. Hence, the rise 
time T; of the system is equal to the system time constant 


i=%, (2.69) 
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Figure 2.22: Rise time of a system. 


This result and Fig. 2.22 show clearly that a system generally does not respond to an input instantaneously. Instead, it takes time 7), for the system 
to respond fully. 


2.7-4 Time Constant and Filtering 


A larger time constant implies a sluggish system because the system takes longer to respond fully to an input. Such a system cannot respond 
effectively to rapid variations in the input. In contrast, a smaller time constant indicates that a system is capable of responding to rapid variations in 
the input. Thus, there is a direct connection between a system's time constant and its filtering properties. 


A high-frequency sinusoid varies rapidly with time. A system with a large time constant will not be able to respond well to this input. Therefore, such 
a system will suppress rapidly varying (high-frequency) sinusoids and other high-frequency signals, thereby acting as a lowpass filter (a filter allowing 
the transmission of low-frequency signals only). We shall now show that a system with a time constant Tp, acts as a lowpass filter having a cutoff 
frequency of f, = 1/T, hertz, so that sinusoids with frequencies below f, hertz are transmitted reasonably well, while those with frequencies above f, 
Hz are suppressed. 


To demonstrate this fact, let us determine the system response to a sinusoidal input x(t) by convolving this input with the effective impulse response 
A(t) in Fig. 2.23a. From Fig. 2.23b and 2.23c we see the process of convolution of h(t) with the sinusoidal inputs of two different frequencies. The 
sinusoid in Fig. 2.23b has a relatively high frequency, while the frequency of the sinusoid in Fig. 2.23c is low. Recall that the convolution of x(T) and 
h(t) is equal to the area under the product x(t)h(t — T). This area is shown shaded in Fig. 2.23b and 2.23c for the two cases. For the high- 
frequency sinusoid, it is clear from Fig. 2.23b that the area under x(T)h(t — T) is very small because its positive and negative areas nearly cancel 
each other out. In this case the output y(t) remains periodic but has a rather small amplitude. This happens when the period of the sinusoid is much 
smaller than the system time constant Ty. In contrast, for the low-frequency sinusoid, the period of the sinusoid is larger than Ty, rendering the 


partial cancellation of area under x(T)h(t-T) less effective. Consequently, the output y(t) is much larger, as depicted in Fig. 2.23c. 
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Figure 2.23: Time constant and filtering. 


Between these two possible extremes in system behavior, a transition point occurs when the period of the sinusoid is equal to the system time 
constant T). The frequency at which this transition occurs is known as the cutoff frequency fc of the system. Because Ty is the period of cutoff 
frequency fo, 


I 
f= (2.70) 
Th 
The frequency f, is also known as the bandwidth of the system because the system transmits or passes sinusoidal components with frequencies 
below f, while attenuating components with frequencies above f,. Of course, the transition in system behavior is gradual. There is no dramatic 
change in system behavior at f, = 1/T,. Moreover, these results are based on an idealized (rectangular pulse) impulse response; in practice these 


results will vary somewhat, depending on the exact shape of h(t). Remember that the "feel" of general system behavior is more important than exact 
system response for this qualitative discussion. 


Since the system time constant is equal to its rise time, we have 


I I 
_ - or f-= 7 (2.7 1a) 


Thus, a system's bandwidth is inversely proportional to its rise time. Although Eq. (2.71a) was derived for an idealized (rectangular) impulse 


T, 


response, its implications are valid for lowpass LTIC systems in general. For a general case, we can show that? 


k 
== 2: 
Si Tr (2.71b) 


where the exact value of k depends on the nature of h(t). An experienced engineer often can estimate quickly the bandwidth of an unknown system 
by simply observing the system response to a step input on an oscilloscope. 


2.7-5 Time Constant and Pulse Dispersion (Spreading) 


In general, the transmission of a pulse through a system causes pulse dispersion (or spreading). Therefore, the output pulse is generally wider than 
the input pulse. This system behavior can have serious consequences in communication systems in which information is transmitted by pulse 
amplitudes. Dispersion (or spreading) causes interference or overlap with neighboring pulses, thereby distorting pulse amplitudes and introducing 
errors in the received information. 


Earlier we saw that if an input x(t) is a pulse of width T,, then 7,, the width of the output y(t), is 


This result shows that an input pulse spreads out (disperses) as it passes through a system. Since T; is also the system's time constant or rise time, 
the amount of spread in the pulse is equal to the time constant (or rise time) of the system. 


2.7-6 Time Constant and Rate of Information Transmission 


In pulse communications systems, which convey information through pulse amplitudes, the rate of information transmission is proportional to the rate 
of pulse transmission. We shall demonstrate that to avoid the destruction of information caused by dispersion of pulses during their transmission 
through the channel (transmission medium), the rate of information transmission should not exceed the bandwidth of the communications channel. 


Since an input pulse spreads out by T, seconds, the consecutive pulses should be spaced T;, seconds apart to avoid interference between pulses. 
Thus, the rate of pulse transmission should not exceed 1/T,, pulses/second. But 1/Tp, = f,, the channel's bandwidth, so that we can transmit pulses 
through a communications channel at a rate of f, pulses per second and still avoid significant interference between the pulses. The rate of 


information transmission is therefore proportional to the channel's bandwidth (or to the reciprocal of its time constant). [T] 


This discussion (Sections 2.7-2-2.7-6) shows that the system time constant determines much of a system's behavior-its filtering characteristics, rise 
time, pulse dispersion, and so on. In turn, the time constant is determined by the system's characteristic roots. Clearly the characteristic roots and 
their relative amounts in the impulse response h(t) determine the behavior of a system. 


2.7-7 The Resonance Phenomenon 


Finally, we come to the fascinating phenomenon of resonance. As we have already mentioned several times, this phenomenon is observed when the 
input signal is identical or is very close to a characteristic mode of the system. For the sake of simplicity and clarity, we consider a first-order system 


having only a single mode, e*. Let the impulse response of this system bel] 


h(t) = Ae (2.73) 
and let the input be 
x(t) = eo 


The system response y(t) is then given by 
y(t) = Ae xe! 


From the convolution table we obtain 


gn 
= Ae(? ~~ ) (2.74) 


Now, as € — 0, both the numerator and the denominator of the term in the parentheses approach zero. Applying L'Hopital's rule to this term yields 


lim y(t) = Ate“ (2.75) 


e-—~>0 


Clearly, the response does not go to infinity as € — 0, but it acquires a factor t, which approaches oo as t — oo If \ has a negative real part (so that 


it lies in the LHP), e4? decays faster than t and y(t) ~ 0 as t ~ oo. The resonance phenomenon in this case is present, but its manifestation is 
aborted by the signal's own exponential decay. 


This discussion shows that resonance is a cumulative phenomenon, not instantaneous. It builds up linearly!S] with ft. When the mode decays 
exponentially, the signal decays too fast for resonance to counteract the decay; as a result, the signal vanishes before resonance has a chance to 
build it up. However, if the mode were to decay at a rate less than 1/t, we should see the resonance phenomenon clearly. This specific condition 
would be possible if Re A = 0. For instance, when Re A = 0, so that A lies on the imaginary axis of the complex plane, and therefore 

= Jw 

and Eq. (2.75) becomes 


y(t) = Ate (2.76) 


Here, the response does go to infinity linearly with t. 


For a real system, if \ = jw is a root, \* = —jw must also be a root; the impulse response is of the form Aet+ Ae Jt = 2A cos wt. The response 
of this system to input A cos wt is 2A cos wt * cos wt. The reader can show that this convolution contains a term of the form At cos 8t. The 
resonance phenomenon is clearly visible. The system response to its characteristic mode increases linearly with time, eventually reaching «, as 
indicated in Fig. 2.24. 


y(t) 


Figure 2.24: Buildup of system response in resonance. 


Recall that when A = jw, the system is marginally stable. As we have indicated, the full effect of resonance cannot be seen for an asymptotically 
stable system; only in a marginally stable system does the resonance phenomenon boost the system's response to infinity when the system's input is 
a characteristic mode. But even in an asymptotically stable system, we see a manifestation of resonance if its characteristic roots are close to the 
imaginary axis, so that Re A is a small, negative value. We can show that when the characteristic roots of a system are o + jwWo, then, the system 


response to the input elt or the sinusoid cos Wot is very large for small oltl. The system response drops off rapidly as the input signal frequency 
moves away from W,. This frequency-selective behavior can be studied more profitably after an understanding of frequency-domain analysis has 
been acquired. For this reason we postpone full discussion of this subject until Chapter 4. 


IMPORTANCE OF THE RESONANCE PHENOMENON 

The resonance phenomenon is very important because it allows us to design frequency-selective systems by choosing their characteristic roots 
properly. Lowpass, bandpass, highpass, and bandstop filters are all examples of frequency-selective networks. In mechanical systems, the 
inadvertent presence of resonance can cause signals of such tremendous magnitude that the system may fall apart. A musical note (periodic 
vibrations) of proper frequency can shatter glass if the frequency is matched to the characteristic root of the glass, which acts as a mechanical 
system. Similarly, a company of soldiers marching in step across a bridge amounts to applying a periodic force to the bridge. If the frequency of this 
input force happens to be nearer to a characteristic root of the bridge, the bridge may respond (vibrate) violently and collapse, even though it would 
have been strong enough to carry many soldiers marching out of step. A case in point is the Tacoma Narrows Bridge failure of 1940. This bridge was 
opened to traffic in July 1940. Within four months of opening (on November 7, 1940), it collapsed in a mild gale, not because of the wind's brute force 
but because the frequency of wind-generated vortices, which matched the natural frequency (characteristic roots) of the bridge, causing resonance. 


Because of the great damage that may occur, mechanical resonance is generally to be avoided, especially in structures or vibrating mechanisms. If 
an engine with periodic force (such as piston motion) is mounted on a platform, the platform with its mass and springs should be designed so that 
their characteristic roots are not close to the engine's frequency of vibration. Proper design of this platform can not only avoid resonance, but also 


attenuate vibrations if the system roots are placed far away from the frequency of vibration. 


T]This definition is satisfactory when h(t) is a single, mostly positive (or mostly negative) pulse. Such systems are lowpass systems. This definition 
should not be applied indiscriminately to all systems. 


tlBecause of varying definitions of rise time, the reader may find different results in the literature. The qualitative and intuitive nature of this 
discussion should always be kept in mind. 


Tl Theoretically, a channel of bandwidth f, can transmit correctly up to 2f, pulse amplitudes per second.!4] Our derivation here, being very simple and 
qualitative, yields only half the theoretical limit. In practice it is not easy to attain the upper theoretical limit. 


TLathi, B. P. Modern Digital and Analog Communication Systems, 3rd ed. Oxford University Press, New York, 1998. 
[t]For convenience we omit multiplying x(t) and h(t) by u(t). Throughout this discussion, we assume that they are causal. 


[Slif the characteristic root in question repeats r times, resonance effect increases as {1 However, 1 et . 0 ast > © for any value of r, 
provided Re A < 0 (A in the LHP). 


[tl This follows directly from Eq. (2.74) with A = o + jw. and €0. 


2.8 APPENDIX 2.1: DETERMINING THE IMPULSE RESPONSE 
In Eq. (2.19), we showed that for an LTIC system S specified by Eq. (2.16), the unit impulse response h(t) can be expressed as 
h(t) = boS(t) + characteristic modes (2.77) 


To determine the characteristic mode terms in Eq. (2.77), let us consider a system S, whose input x(t) and the corresponding output w(t) are related 
by 


O(D)w(t) = x(t) (2.78) 


Observe that both the systems S and S, have the same characteristic polynomial; namely, Q(A), and, consequently, the same characteristic modes. 
Moreover, Sy is the same as S with P(D) = 1, that is, bg = 0. Therefore, according to Eq. (2.77), the impulse response of Sg consists of characteristic 
mode terms only without an impulse at ¢ = 0. Let us denote this impulse response of S, by y,(t). Observe that y n(t) consists of characteristic modes 
of S and therefore may be viewed as a zero-input response of S. Now y,(f) is the response of Sp to input 5(t). Therefore, according to Eq. (2.78) 


O(D)y,(t) = 5(t) (2.79a) 
or 

(DY +a;D""' +--+» tani D + ay)ya(t) = 8(t) (2.79b) 
or 

V(t) + ayy h(n) + e+ Fay yD) + an y(t) = S(t) (2.79¢) 


where y(t) represents the kth derivative of y,(t). The right-hand side contains a single impulse term, 8(t). This is possible only if y\N-1) (t) has a 
unit jump discontinuity at f = 0, so that yl) ,(t) = 6(t). Moreover, the lower-order terms cannot have any jump discontinuity because this would mean 


the presence of the derivatives of 5(t). Therefore y,,(0) = yi, (O)=...= y\N-2) (0) = 0 (no discontinuity at t = 0), and the N initial conditions on y,(t) 
are 

y*-)(0) = 1 

ya(O) = (0) = --- = yO) = 0 (2.80) 


This discussion means that y,(t) is the zero-input response of the system S subject to initial conditions (2.80). 
We now show that for the same input x(t) to both systems, S and So, their respective outputs y(t) and w(t) are related by 
y(t) = P(D)w(t) (2.81) 


To prove this result, we operate on both sides of Eq. (2.78) by P(D) to obtain 
Q(D)P(D)w(t) = P(D)x(t) 


Comparison of this equation with Eq. (2.1c) leads immediately to Eq. (2.81). 


Now if the input x(t) = 8(t), the output of S, is y,(t), and the output of S, according to Eq. (2.81), is P(D)y,(t). This output is h(t), the unit impulse 
response of S. Note, however, that because it is an impulse response of a causal system So, the function y,,(t) is causal. To incorporate this fact we 
must represent this function as y,(t)u(t). Now it follows that A(t), the unit impulse response of the system S, is given by 


h(t) = P(D)f[y,(Hu(p)] (2.82) 


where y,(t) is a linear combination of the characteristic modes of the system subject to initial conditions (2.80). 


The right-hand side of Eq. (2.82) is a linear combination of the derivatives of y,(t)u(t). Evaluating these derivatives is clumsy and inconvenient 
because of the presence of u(t). The derivatives will generate an impulse and its derivatives at the origin. Fortunately when M < N [Eq. (2.16)], we 
can avoid this difficulty by using the observation in Eq. (2.77), which asserts that at t = 0 (the origin), h(t) = b98(t). Therefore, we need not bother to 
find h(t) at the origin. This simplification means that instead of deriving P(D)[y,(t)u(t)], we can derive P(D)y,(t) and add to it the term b98(f), so that 


h(t) = bod (t) + P(D)y, (0) 1>0 


= bod(t) + | P(D) yn (t) u(t) (2.83) 
This expression is valid when M < N [the form given in Eq. (2.16b)]. When M > N, Eq. (2.82) should be used. 


2.9 SUMMARY 


This chapter discusses time-domain analysis of LTIC systems. The total response of a linear system is a sum of the zero-input response and zero- 
state response. The zero-input response is the system response generated only by the internal conditions (initial conditions) of the system, assuming 
that the external input is zero; hence the adjective "zero-input." The zero-state response is the system response generated by the external input, 
assuming that all initial conditions are zero, that is, when the system is in zero state. 


Every system can sustain certain forms of response on its own with no external input (zero input). These forms are intrinsic characteristics of the 
system; that is, they do not depend on any external input. For this reason they are called characteristic modes of the system. Needless to say, the 
zero-input response is made up of characteristic modes chosen in a combination required to satisfy the initial conditions of the system. For an Nth- 
order system, there are N distinct modes. 


The unit impulse function is an idealized mathematical model of a signal that cannot be generated in practice. [7] Nevertheless, introduction of such a 
signal as an intermediary is very helpful in analysis of signals and systems. The unit impulse response of a system is a combination of the 


characteristic modes of the system|4] because the impulse 8(f) = 0 for t > 0. Therefore, the system response for tf > 0 must necessarily be a zero- 
input response, which, as seen earlier, is a combination of characteristic modes. 


The zero-state response (response due to external input) of a linear system can be obtained by breaking the input into simpler components and then 
adding the responses to all the components. In this chapter we represent an arbitrary input x(t) as a sum of narrow rectangular pulses [staircase 
approximation of x(t)]. In the limit as the pulse width — 0, the rectangular pulse components approach impulses. Knowing the impulse response of 
the system, we can find the system response to all the impulse components and add them to yield the system response to the input x(t). The sum of 
the responses to the impulse components is in the form of an integral, known as the convolution integral. The system response is obtained as the 
convolution of the input x(t) with the system's impulse response h(t). Therefore, the knowledge of the system's impulse response allows us to 
determine the system response to any arbitrary input. 


LTIC systems have a very special relationship to the everlasting exponential signal e* because the response of an LTIC system to such an input 


signal is the same signal within a multiplicative constant. The response of an LTIC system to the everlasting exponential input et is H(s)e**, where 
H(s) is the transfer function of the system. 


Differential equations of LTIC systems can also be solved by the classical method, in which the response is obtained as a sum of natural and forced 
response. These are not the same as the zero-input and zero-state components, although they satisfy the same equations respectively. Although 
simple, this method is applicable to a restricted class of input signals, and the system response cannot be expressed as an explicit function of the 
input. These limitations make it useless in the theoretical study of systems. 


If every bounded input results in a bounded output, the system is stable in the bounded-input/bounded-output (BIBO) sense. An LTIC system is 
BIBO stable if and only if its impulse response is absolutely integrable. Otherwise, it is BIBO unstable. BIBO stability is a stability seen from external 
terminals of the system. Hence, it is also called external stability or zero-state stability. 


In contrast, the internal stability (or the zero-input stability) examines the system stability from inside. When some initial conditions are applied to a 
system in zero state, then, if the system eventually returns to zero state, the system is said to be stable in the asymptotic or Lyapunov sense. If the 
system's response increases without bound, it is unstable. If the system does not go to zero state and the response does not increase indefinitely, 
the system is marginally stable. The internal stability criterion, in terms of the location of a system's characteristic roots, can be summarized as 
follows. 


1. An LTIC system is asymptotically stable if, and only if, all the characteristic roots are in the LHP. The roots may be repeated or 
unrepeated. 


2. An LTIC system is unstable if, and only if, either one or both of the following conditions exist: (i) at least one root is in the RHP; (ii) 
there are repeated roots on the imaginary axis. 


3. An LTIC system is marginally stable if, and only if, there are no roots in the RHP, and there are some unrepeated roots on the 
imaginary axis. 


It is possible for a system to be externally (BIBO) stable but internally unstable. When a system is controllable and observable, its external and 
internal descriptions are equivalent. Hence, external (BIBO) and internal (asymptotic) stabilities are equivalent and provide the same information. Such 
a BIBO-stable system is also asymptotically stable, and vice versa. Similarly, a BIBO-unstable system is either marginally stable or asymptotically 
unstable system. 


The characteristic behavior of a system is extremely important because it determines not only the system response to internal conditions (zero-input 
behavior), but also the system response to external inputs (zero-state behavior) and the system stability. The system response to external inputs is 


determined by the impulse response, which itself is made up of characteristic modes. The width of the impulse response is called the time constant 
of the system, which indicates how fast the system can respond to an input. The time constant plays an important role in determining such diverse 
system behavior as the response time and filtering properties of the system, dispersion of pulses, and the rate of pulse transmission through the 
system. 


[t]However, it can be closely approximated by a narrow pulse of unit area and having a width that is much smaller than the time constant of an LTIC 
system in which it is used. 


[tl There is the possibility of an impulse in addition to the characteristic modes. 
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MATLAB SESSION 2: M-FILES 


M-files are stored sequences of MATLAB commands and help simplify complicated tasks. There are two types of M-file: script and function. Both 
types are simple text files and require a.m filename extension. 


Although M-files can be created by using any text editor, MATLAB's built-in editor is the preferable choice because of its special features. As with 
any program, comments improve the readability of an M-file. Comments begin with the % character and continue through the end of the line. 


An M-file is executed by simply typing the filename (without the .m extension). To execute, M-files need to be located in the current directory or any 
other directory in the MATLAB path. New directories are easily added to the MATLAB path by using the addpath command. 


M2.1 Script M-Files 


Script files, the simplest type of M-file, consist of a series of MATLAB commands. Script files record and automate a series of steps, and they are 
easy to modify. To demonstrate the utility of a script file, consider the operational amplifier circuit shown in Fig. M2.1. 


Ry 


Figure M2.1: Operation amplifier circuit. 


The system's characteristic modes define the circuit's behavior and provide insight regarding system behavior. Using ideal, infinite gain difference 
amplifier characteristics, we first derive the differential equation that relates output y(t) to input x(t). Kirchhoff's current law (KCL) at the node shared 
by R41 and R3 provides 


x(t) — v(t) n y(t) — v(t) ‘ 0 — v(t) 


— C,v(t) =0 
Rk; R> Ri 
KCL at the inverting input of the op amp gives 
v(t) ; 
— + C(t) = 0 
R, . 
Combining and simplifying the KCL equations yields 
l l l l 1 1 
PL) + — ) ht) +E — (2) = tI 
+o R mR }M + RRCiCa , Ri Rs, C2 w 


which is the desired constant coefficient differential equation. Thus, the characteristic equation is given by 


> 1 1 1 1 1 . 
Meme He Ht A l(a + A +) =O (M2.1) 
{3 R x} aa 


The roots Aj and Az of Eq. (M2.1) establish the nature of the characteristic modes et! and ed2t, 


As a first case, assign nominal component values of R =R =R =10kQandC =C =1 uF. A series of MATLAB commands allows convenient 


1 2 3 1 2 
computation of the roots \ = [A1;Ag]. Although A can be determined using the quadratic equation, MATLAB's roots command is more convenient. 
The roots command requires an input vector that contains the polynomial coefficients in descending order. Even if a coefficient is zero, it must still be 
included in the vector. 


MS2P1.m : MATLAB Session 2, Program 1 
Script M-file determines characteristic roots of op-amp circuit. 


a? al? 


Set component values: 

= [le4, le4, 1le4]; 

= [le-6, le-6]; 

Determine coefficients for characteristic equation: 


(1/R (1) + 1/R (2) + 1/R (3)) /C (2); 
1/R(1) *R (2) *C(1) *C(2)); 

= [a0 al a2]; 

Determine characteristic roots: 
ambda = roots (A); 


Hoe Dea m® @ we oe 
MFO 
Wl 


A script file is created by placing these commands in a text file, which in this case is named MS 2 P1. m. While comment lines improve program 
clarity, their removal does not affect program functionality. The program is executed by typing: 


>> MS2P1 


After execution, all the resulting variables are available in the workspace. For example, to view the characteristic roots, type: 


>> lambda 
lambda = -261.8034 
-38.1966 


-261.8034t -38.1966t 


Thus, the characteristic modes are simple decaying exponentials: e and e 


Script files permit simple or incremental changes, thereby saving significant effort. Consider what happens when capacitor C; is changed from 1.0 UF 
to 1.0 uF. Changing MS2PI.msothatc = [1e-9, 1e-6], allows computation of the new characteristic roots: 


>> MS2P1 

>> lambda 

lambada = 1.0e+003 * 
=0 1500 -+ 33.1587 
-0.1500 - 3.1587i 


Perhaps surprisingly, the characteristic modes are now complex exponentials capable of supporting oscillations. The imaginary portion of \ dictates 
an oscillation rate of 3158.7 rad/s or about 503 Hz. The real portion dictates the rate of decay. The time expected to reduce the amplitude to 25% is 
approximately t = In 0.25/Re~ 0.01 second. 


M2.2 Function M-Files 


It is inconvenient to modify and save a script file each time a change of parameters is desired. Function M-files provide a sensible alternative. Unlike 
script M-files, function M-files can accept input arguments as well as return outputs. Functions truly extend the MATLAB language in ways that script 
files cannot. 


Syntactically, a function M-file is identical to a script M-file except for the first line. The general form of the first line is: 
function [outputi, output2, ...,outputN] = filename(input1, input2,...,inputM) 


For example, consider modification of MS2P1. m to make function MS2P2.m. Component values are passed to the function as two separate inputs: a 
length-3 vector of resistor values and a length-2 vector of capacitor values. The characteristic roots are returned as a 2 x 1 complex vector. 


function [lambda] = MS2P2 (R, C) 
MS2P2.m : MATLAB Session 2, Program 2 
Function M-file determines characteristic roots of 
op-amp circuit. 
INPUTS: R =length-3 vector of resistances 

C = length-2 vector of capacitances 
OUTPUTS: lambda = characteristic roots 


AP AXP oP al al? AIO 


% Determine coefficients for characteristic equation: 
aQ = 1; 

al = (1/R(1) + 1/R(2) + 1/R (3))/C(2); 

a2 = 1/(R(1) *R (2) *C(1) *C(2)); 

A = [a0 al a2]; 

% Determine characteristic roots: 

lambda = roots (A); 


As with script M-files, function M-files execute by typing the name at the command prompt. However, inputs must also be included. For example, 
MS2P2 easily confirms the oscillatory modes of the preceding example. 

>> lambda = MS2P2([le4, le4, le4], [le-9, le-6]) 

lambda = 1.0e + 003 * 


-0..1500 4+ 3.15872 
=0.1900 = 3.15872 


Although scripts and functions have similarities, they also have distinct differences that are worth pointing out. Scripts operate on workspace data; 
functions must either be supplied data through inputs or create their own data. Unless passed as an output, variables and data created by functions 


remain local to the function; variables or data generated by scripts are global and are added to the workspace. To emphasize this point, consider 
polynomial coefficient vector A, which is created and used in both MS2P1.m and MS2P2.m. Following execution of function MS2P2, the variable A is 
not added to the workspace. Following execution of script MS2P1, however, A is available in the workspace. Recall, the workspace is easily viewed 
by typing either who or whos. 


M2.3 For-Loops 


Real resistors and capacitors never exactly equal their nominal values. Suppose that the circuit components are measured as Ry = 10.322 k, Ro = 
9.952 k, R3 = 10.115 k Cy = 1.120nF, and Co = 1.320 UF. These values are consistent with the 10 and 25% tolerance resistor and capacitor values 
commonly and readily available. MS2P2.m uses these component values to calculate the new values of \. 


>> lambda = MS2P2 ([10322, 9592, 10115], [1.12e-9, 1.32e-6]) 
lambda = 1.0e+003 * 

=0..1136 + 2.61132 

-0.1136 = 2.61131 


Now the natural modes oscillate at 2611.3 rad/s or about 416 Hz. Decay to 25% amplitude is expected in t = In 0.25/(— 113.6) = 0.012 second. 
These values, which differ significantly from the nominal values of 503 Hz and t ~ 0.01 second, warrant a more formal investigation of the effect of 
component variations on the locations of the characteristic roots. 


It is sensible to look at three values for each component: the nominal value, a low value, and a high value. Low and high values are based on 
component tolerances. For example, a 10% 1k Q resistor could have an expected low value of 1000(1 — 0.1) = 9000 and an expected high value of 


1000(1 + 0.1) = 1100 Q. For the five passive components in the design, 35 = 243 permutations are possible. 


Using either MS2 PI.morMS2 P2 .mto solve each of the 243 cases would be very tedious and boring. For-loops help automate repetitive tasks 
such as this. In MATLAB, the general structure of a for statement is: 


for variable = expression, statement,..., statement, end 


Five nested for-loops, one for each passive component, are required for the present example. 


MS2P3.m : MATLAB Session 2, Program 3 
Script M-file determines characteristic roots over 
a range of component values. 


AP al ol? 


% Pre-allocate memory for all computed roots: 
lambda = zeros(2, 243); 

% Initialize index to identify each permutation: 
p=0; 

for Rl = le4* [0.9, 1.0, 1.1], 

for R2 = le4* [0.9, 1.0, 1.1], 

for R3 = le4* [0.9, 1.0, 1.1], 

for Cl = le-9* [0.75, 1.0, 1.25], 

for C2 = le-6*[0.75,1.0,1.25], 

p= ptl; 

lambda (:, p) = MS2P2 ([R1 R2 R3], [Cl C2]); 
end 

end 

end 

end 

end 


plot (real(lambda(:)), imag(lambda(:)), 'kx',... 

real (lambda(:, 1)), image (lambda(:, 1)), 'kv',... 

real (lambda(:, end)), imag(lambda(:, end)), 'k*"') 

xlabel ('Real'), ylabel ('Imaginary') 

legend('Characteristic Roots', 'Min-Component Values Roots',... 
"Max-Component Values Roots', 0); 


The command lambda = zeros (2,243) preallocates a 2 x 243 array to store the computed roots. When necessary, MATLAB performs dynamic 
memory allocation, so this command is not strictly necessary. However, preallocation significantly improves script execution speed. Notice also that it 
would be nearly useless to call script MS2P1 from within the nested loop; script file parameters cannot be changed during execution. 


The plot instruction is quite long. Long commands can be broken across several lines by terminating intermediate lines with three dots (...). The three 
dots tell MATLAB to continue the present command to the next line. Black x's locate roots of each permutation. The command lambda (:) 
vectorizes the 2 x 243 matrix lambda into a 486 x 1 vector. This is necessary in this case to ensure that a proper legend is generated. Because of 
loop order, permutation p = 1 corresponds to the case of all components at the smallest values and permutation p = 243 corresponds to the case of 
all components at the largest values. This information is used to separately highlight the minimum and maximum cases using down-triangles (V) and 
up-triangles (A), respectively. In addition to terminating each for loop, end is used to indicate the final index along a particular dimension, which 
eliminates the need to remember the particular size of a variable. An overloaded function, such as end, serves multiple uses and is typically 
interpreted based on context. 


The graphical results provided by MS2P3 are shown in Fig. M2.2. Between extremes, root oscillations vary from 365 to 745 Hz and decay times to 
25% amplitude vary from 6.2 to 12.7 ms. Clearly, this circuit's behavior is quite sensitive to ordinary component variations. 
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Figure M2.2: Effect of component values on characteristic root locations. 


M2.4 Graphical Understanding of Convolution 


MATLAB graphics effectively illustrate the convolution process. Consider the case of y(t) = x(t) * h(t), where x(t) = sin (trf)(u(t) — u(t — 1)) and h(t) 
=1.5(u(t) — u(t — 1.5)) —u(t — 2) + u(t — 2.5). Program MS2P4 steps through the convolution over the time interval (—0.25 < t < 3.75). 


MS2p4.m : MATLAB Session 2, Program 4 
Script M-file graphically demonstrates the convolution process. 


a al? 


figure (1) % Create figure window and make visible on screen 
x = inline('1.5*sin(pi*t).*(t>=0 & t<1)'); 


h = inline('1.5* (t>=O0&t<1.5) - (t>=2&t<2.5)'); 
dtau = 0.005; tau = -1l:dtau:4; 
ti = 0; twee = =.,25:.1:3.75;) 


2 


y = NaN*xeros(1, length (tvec)); % Pre-allocate memory 
for t = tvec, 


ti = titl; % Time index 

xh = x(t-tau).*h(tau); lxh = length (xh); 

y(ti) = sum(xh.*dtau); % Trapezoidal approximation of interal 

subplot (2,1,1), plot(tau, h(tau), 'k-', tau, x(t-tau), 'k- -', t, 0, ‘'ok'); 


axis ([tau (1) tau(end) -2.0 2.5]); 

patch([tau(l:end-1); tau(l:end-1); tau (2:end); tau (2:end)],... 
[zeros (1,1xh-1);xh(l:end-1);xh(2:end);zeros(1,1xh-1)],... 

[.8 .8 .8], '‘edgecolor', 'none'); 


(xlabel'\tau'); legend('h(\tau)', 'x(t-\tau);'t ', 'h(\tau) x (t-\tau)', 3); 
c = get(gca, 'children'); set (gca, 'children', [c(2); ¢c(3); c(4); c(1)]1); 
subplot (2, 1, 2), plot (tvec, y, 'k', tvec (ti), y(ti), 'ok'); 

xlabel ('t'); ylabel ('y(t) = \int h(\tau)x(t-\tau) d\tau'); 

axis ([tau(1) tau(end) -1.0 2.0]); grid; 

drawnow; 

end 


At each step, the program plots h(T), x(t — T), and shades the area h(T)x(t — T) gray. This gray area, which reflects the integral of h(T)x(t — T) is 
also the desired result, y(t). Figures M2.3, M2.4, and M2.5 display the convolution process at times t of 0.75, 2.25, and 2.85 seconds, respectively. 
These figures help illustrate how the regions of integration change with time. Figure M2.3 has limits of integration from 0 to (f = 0.75). Figure M2.4 
has two regions of integration, with limits (¢ — 1 = 1.25) to 1.5 and 2.0 to (t = 2.25). The last plot, Fig. M2.5, has limits from 2.0 to 2.5. 
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Figure M2.3: Graphical convolution at step t = 0.75 seconds. 
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Figure M2.4: Graphical convolution at step t = 2.25 seconds. 
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Figure M2.5: Graphical convolution at step t = 2.85 seconds. 


Several comments regarding MS2P4 are in order. The command figure (1) opens the first figure window and, more important, makes sure it is 
visible. Inline objects are used to represent the functions x(t) and A(t). NaN, standing for not-a-number, usually results from operations such as 0/0 or 
co — co. MATLAB refuses to plot NaN values, so preallocating y(t) with NaNs ensures that MATLAB displays only values of y(t) that have been 
computed. As its name suggests, length returns the length of the input vector. The subplot (a, b, c) command partitions the current figure 
window into an a-by-b matrix of axes and selects axes c for use. Subplots facilitate graphical comparison by allowing multiple axes in a single figure 
window. The patch command is used to create the gray-shaded area for h(T)x(t — T). In MS2P4, the get and set commands are used to reorder 
plot objects so that the gray area does not obscure other lines. Details of the patch, get, and set commands, as used in MS2P4, are somewhat 


advanced and are not pursued here.'t] MATLAB also prints most Greek letters if the Greek name is preceded by a backslash (/) character. For 
example, /tau in the xlabel command produces the symbol T in the plot's axis label. Similarly, an integral sign is produced by /int. Finally, the 
drawnow command forces MATLAB to update the graphics window for each loop iteration. Although slow, this creates an animation-like effect. 
Replacing drawnow with the pause command allows users to manually step through the convolution process. The pause command still forces the 
graphics window to update, but the program will not continue until a key is pressed. 


[tlInterested students should consult the MATLAB help facilities for further information. Actually, the get and set commands are extremely powerful 
and can help modify plots in almost any conceivable way. 


PROBLEMS 


2.2.1. AnLTIC system is specified by the equation 
(D? + 5D + 6)y(t) = (D + I)x(t) 


a. Find the characteristic polynomial, characteristic equation, characteristic roots, and characteristic modes of this system. 


b. Find yo(t) the zero-input component of the response y(t) for t = 0, if the initial conditions are yo(0) = 2 and 
¥o(O-) = —1. 


2.2.2 Repeat Prob. 2.2-1 for 
(D? + 4D + 4)y(t) = Dx(t) 
and Yo(0~) = —4. 


2.2.3. Repeat Prob. 2.2-1 for 
D(D + ly) = (D+ Dx(H 


and Yo(07) = 1 


2.2.4 Repeat Prob. 2.2-1 for 
(D? + 9) y(t) = (3D + 2)x(0) 


and Yo(0") = 6, 


2.2.5 


2.2.6 


2.2.7 


2.2.8 


2.3.1 


2.3.2 


2.3.3 


2.3.4 


2.4.1 


2.4.2 


2.4.3 


2.4.4 


2.4.5 


2.4.6 


2.4.7 


2.4.8 


Repeat Prob. 2.2-1 for 
(D? + 4D + 13)y(t) = 4(D + 2)x(t) 


with Yo(O~) = 15.98, 


Repeat Prob. 2.2-1 for 
D*(D + ly (t) = (D? + 2)x(t) 


with Yo(O~) = 3, 

Repeat Prob. 2.2-1 for 

woO-) = -1 

with Yo(O~) = 2, ¥o(0~) = —1 and ¥o(O~) = 5S. 


A system is described by a constant-coefficient linear differential equation and has zero-input response given by yo(t) = 2e' +3. 


a. Is it possible for the system's characteristic equation to be A + 1 = 0? Justify your answer. 
b. Is it possible for the system's characteristic equation to be /3 (A2 + A) = 0? Justify your answer. 


c. ls it possible for the system's characteristic equation to be A(A + 1)2 = 0? Justify your answer. 


Find the unit impulse response of a system specified by the equation 
(D? + 4D + 3)y(t) = (D + 5)x(t) 


Repeat Prob. 2.3-1 for 
(D? + 5D + 6)y(t) = (D? +7D + 11)x(t) 


Repeat Prob. 2.3-1 for the first-order allpass filter specified by the equation 
(D+ Dy) = —(D — Dx) 


Find the unit impulse response of an LTIC system specified by the equation 
9 m - 
(D* + 6D + 9) y(t) = (2D + 9)x(t) 


If c(t) = x(t) * g(t), then show that A; = AyAg, where Ay, Ag, and Ac are the areas under x(t), g(t), and c(t), respectively. Verify this 
area property of convolution in Examples 2.7 and 2.9. 


If x(t) * g(t) = c(t), then show that x(at) * g(at) = |1/a|c(at). This time-scaling property of convolution states that if both x(t) and g(t) 
are time-scaled by a, their convolution is also time-scaled by a (and multiplied by |1/a]). 


Show that the convolution of an odd and an even function is an odd function and the convolution of two odd or two even functions is 
an even function. [Hint: Use time-scaling property of convolution in Prob. 2.4-2.] 


Using direct integration, find e y(t) * @ bt u(t). 
Using direct integration, find u(t) * u(t), e~ u(t) *e- u(t), and tu(t) *u(t). 
Using direct integration, find sin t u(t) *u(t) and cos ¢ u(t) *u(t). 


The unit impulse response of an LTIC system is 


h(t) =e fut) 
Find this system's (zero-state) response y(t) if the input x(t) is: 
a. u(t) 
b. e u(t) 
Cc. e2tu(t) 
d. sin 3t u(t) 
Use the convolution table (Table 2.1) to find your answers. 


Repeat Prob. 2.4-7 for 
h(t) = [2e7** — e~™* Jutt) 


and if the input x(f) is: 


2.4.9 Repeat Prob. 2.4-7 for 
P a! 
h(t) = (1 — 2t)e"*u(t) 


and input x(t) = u(t). 


2.4.10 Repeat Prob. 2.4-7 for 
h(t) = 4e~” cos 3t u(t) 


and each of the following inputs x(t): 
a. u(t) 
b. e‘u(t) 


2.4.11 Repeat Prob. 2.4-7 for 
h(t) =e"' u(t) 


and each of the following inputs x(t): 
a. e 2fu(t) 
b. e2f-3)u(t) 


c. e 2fu(t — 3) 


d. The gate pulse depicted in Fig. P2.4-11-and provide a sketch of y(t). 
x(t) 


0 1 i —- 
Figure P2.4-11 


2.4.12 A first-order allpass filter impulse response is given by 
h(t) = —8(t) + 2e u(t) 


a. Find the zero-state response of this filter for the input etu(—t). 
b. Sketch the input and the corresponding zero-state response. 


2.4.13 Figure P2.4-13 shows the input x(t) and the impulse response h(t) for an LTIC system. Let the output be y(f). 


Figure P2.4-13 


a. By inspection of x(t) and A(t), find y(-1), y(0), y(1), y(2), y(3), y(4), y(5), and y(6). Thus, by merely examining x(t) and 
h(t), you are required to see what the result of convolution yields at f= —1, 0, 1, 2, 3, 4, 5, and 6. 


b. Find the system response to the input x(t). 


2.4.14 The zero-state response of an LTIC system to an input x(t) = 2e-2tu(t) is y(t) = [4e72! + 6e u(t). Find the impulse response of the 


system. [Hint: We have not yet developed a method of finding A(t) from the knowledge of the input and the corresponding output. 
Knowing the form of x(t) and y(t), you will have to make the best guess of the general form of h(t).] 


2.4.15 Sketch the functions x(t) — 12 + 1) and u(t). Now find x(t) * u(t) and sketch the result. 


2.4.16 Figure P2.4-16 shows x(t) and g(t). Find and sketch c(t) = x(t) * g(t). 


Figure P2.4-16 


2.4.17 Find and sketch c(t) = x(t) * g(t) for the functions depicted in Fig. P2.4-17. 


Figure P2.4-17 


2.4.18 | Find and sketch c(t) = x4(t) * xo(t) for the pairs of functions illustrated in Fig. P2.4-18. 
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Figure P2.4-18 


2.4.19 Use Eq. (2.46) to find the convolution of x(t) and w(t), shown in Fig. P2.4-19. 


att) wit) 
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Figure P2.4-19 


2.4.20 Determine H(s), the transfer function of an ideal time delay of T seconds. Find your answer by two methods: using Eq. (2.48) and 
using Eq. (2.49). 


2.4.21. Determine y(t) = x(t)*h(t) for the signals depicted in Fig. P2.4-21. 
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Figure P2.4-21: Analog signals x(t) and h(?). 


2.4.22 Two linear time-invariant systems, each with impulse response h(t), are connected in cascade. Refer to Fig. P2.4-22. Given input x(t) 
= u(t), determine y(1). That is, determine the step response at time t = 1 for the cascaded system shown. 


rn) vn 


Figure P2.4-22: Impulse response and cascade system. 
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2.4.23 Consider the electric circuit shown in Fig. P2.4-23. 
a. Determine the differential equation that relates the input x(t) to output y(t). Recall 


that 


/ di 
ic(t) =C—* and w(t) = L— 


b. Find the characteristic equation for this circuit, and express the root(s) of the characteristic equation in terms of L and 
C. 


c. Determine the zero-input response given an initial capacitor voltage of one volt and an initial inductor current of zero 
amps. That is, find yo(t) given v,(0) = 1 V and i, (0) = 0 A. [Hint: The coefficient(s) in yo(t) are independent of L and C_] 


d. Plot yo(t) for t => 0. Does the zero-input response, which is caused solely by initial conditions, ever "die" out? 


1 


e. Determine the total response y(t) to the input x(t) = e” ‘u(t). Assume an initial inductor current of i, (0°) = 0 A, an initial 


capacitor voltage of v,(0°-) =1V,L=1H,and C=1F. 


L 
+} 
x(t) ee y(t) 
Figure P2.4-23: LC circuit. 
2.4.24 Two LTIC systems have impulse response functions given by h,(t) = (1 — f)[u(t) — u(t — 1)] and hAo(t) = tlu(t + 2) — u(t — 2)]. 
a. Carefully sketch the functions h(t) and ho(t). 


b. Assume that the two systems are connected in parallel as shown in Fig. P2.4-24a. Carefully plot the equivalent impulse 
response function, hp(t). 
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Figure P2.4-24: (a) Parallel and (b) series connections. 


c. Assume that the two systems are connected in cascade as shown in Fig. P2.4-24a. Carefully plot the equivalent 
impulse response function, h(t). 


2.4.25 Consider the circuit shown in Fig. P2.4-25. 
a. Find the output y(t) given an initial capacitor voltage of y(0) = 2 V and an input x(t) = u(t). 


b. Given an input x(t) = u(t — 1), determine the initial capacitor voltage y(0) so that the output y(f) is 0.5 volt at f= 2 
seconds. 


x(t) Cc vg) 


Figure P2.4-25: RCcircuit. 


2.4.26 An analog signal is given by x(t) = ¢[u(t) — u(t — 1)], as shown in Fig. P2.4-26. Determine and plot y(t) = x(t) * x(2t) 


Figure P2.4-26: Short-duration ramp signal x(t). 


2.4.27. Consider the electric circuit shown in Fig. P2.4-27. 


2.4.28 


2.4.29 


2.4.30 


2.4.31 


a. Determine the differential equation that relates the input current x(t) to output current y(t). Recall that 


di, 
v, = L— 
. dt 
b. Find the characteristic equation for this circuit, and express the root(s) of the characteristic equation in terms of L4, Lo, 


and R. 


c. Determine the zero-input response given initial inductor currents of one ampere each. That is, find y(t) given i, 4 (0) = 
i, 2(0) =1A. 


Figure P2.4-27: RLL circuit. 


An LTI system has step response given by g(t) = e~'u(t) — etu(t), Determine the output of this system y(t) given an input x(t) = 
&(t — 1) — cos(./3)u(t). 


The periodic signal x(t) shown in Fig. P2.4-29 is input to a system with impulse response function h(t) 


= t[u(t) — u(t — 1.5)], also 
shown in Fig. P2.4-29. Use convolution to determine the output y(t) of this system. Plot y(t) over (—3 < t < 3). 


) 


Figure P2.4-29: Periodic input x(t). 
Consider the electric circuit shown in Fig. P2.4-30. 


a. Determine the differential equation relating input x(t) to output y(t). 


b. Determine the output y(t) in response to the input x(t) = Ate 3t!2 y(t). Assume component values of R= 1 0, C1 =1 F, 
and Cz = 2 F, and initial capacitor voltages of Vc, = 2 V and Vc = 1 V. 


x(t) 


Figure P2.4-30: RCC circuit. 


A cardiovascular researcher is attempting to model the human heart. He has recorded ventricular pressure, which he believes 
corresponds to the heart's impulse response function h(t), as shown in Fig. P2.4-31. Comment on the function h(t) shown in Fig. 
P2.4-31. Can you establish any system properties, such as causality or stability? Do the data suggest any reason to suspect that the 
measurement is not a true impulse response? 
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Figure P2.4-31: Measured impulse response function. 


2.4.32 The autocorrelation of a function x(t) is given by ry,(t) = [°-.o x(T)x(T — t)dT. This equation is computed in a manner nearly 
identical to convolution. 


a. Show ry,(t) = x(t) * x(t) 


b. Determine and plot r,,(f) for the signal x(t) depicted in Fig. P2.4-32. [Hint: ry,(t) = ryyx(—f).] 


Figure P2.4-32: Analog signal x(¢). 


2.4.33. Consider the circuit shown in Fig. P2.4-33. This circuit functions as an integrator. Assume ideal op-amp behavior and recall that 
; dVe 
ic = C— 
g dt 


a. Determine the differential equation that relates the input x(t) to the output y(¢). 


b. This circuit does not behave well at dc. Demonstrate this by computing the zero-state response y(t) for a unit step input 
x(t) = u(t). 


Figure P2.4-33: Integrator op-amp circuit. 


2.4.34 Derive the result in Eq. (2.46) in another way. As mentioned in Chapter 1 (Fig. 1.276), it is possible to express an input in terms of 
its step components, as shown in Fig. P2.4-34. Find the system response as a sum of the responses to the step components of the 
input. 
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Figure P2.4-34 


2.4.35 Show that an LTIC system response to an everlasting sinusoid cos wof is given by 
y(t) = |H (Ja)| cos [wot + LH(joo)] 


where 


=) 
H (ja) = / h(t)e2™ dt 


ao 


assuming the integral on the right-hand side exists. 


2.4.36 A line charge is located along the x axis with a charge density Q(x) coulombs per meter. Show that the electric field E(x) produced 
by this line charge at a point x is given by 


E(x) = O(x) «h(x) 


where h(x) = 1/4ttex?. [Hint: The charge over an interval At located at T = nAT is Q(nAT) At. Also by Coulomb's law, the electric 
field E(r) at a distance r from a charge q coulombs is given by E(r) = ql4trer? |] 


2.4.37 Consider the circuit shown in Fig. P2.4-37. Assume ideal op-amp behavior and recall that 


Figure P2.4-37: Lossy integrator op-amp circuit. 


Without a feedback resistor Ry, the circuit functions as an integrator and is unstable, particularly at dc. A feedback resistor R; corrects 
this problem and results in a stable circuit that functions as a "lossy" integrator. 


a. Determine the differential equation that relates the input x(t) to the output y(t). What is the corresponding characteristic 
equation? 


b. To demonstrate that this "lossy" integrator is well behaved at dc, determine the zero-state response y(t) given a unit 
step input x(t) = u(t). 


c. Investigate the effect of 10% resistor and 25% capacitor tolerances on the system's characteristic root(s). 
2.4.38 Consider the electric circuit shown in Fig. P2.4-38. Let Cy = Co = 10 uF, Ry = Ro = 100 kQ, and R3 = 50 kO. 

a. Determine the corresponding differential equation describing this circuit. Is the circuit BIBO stable? 

b. Determine the zero-input response yo(t) if the output of each op amp initially reads one volt. 

c. Determine the zero-state response y(t) to a step input x(t) = u(t). 


d. Investigate the effect of 10% resistor and 25% capacitor tolerances on the system's characteristic roots. 


Cc 


Figure P2.4-38: Op-amp circuit. 


2.4.39 A system is called complex if a real-valued input can produce a complex-valued output. Suppose a linear, time-invariant complex 
system has impulse response h(t) = j[u(—t + 2) — u(—d)]. 


a. Is this system causal? Explain. 


b. Use convolution to determine the zero-state response y;(t) of this system in response to the unit-duration pulse x(t) = 
u(t) — u(t — 1). 


c. Using the result from part b, determine the zero-state response y(t) in response to xo(t) = 2u(t — 1) — u(t — 2) —u(t 
— 3). 


2.5.1 Use the classical method to solve 
(D? + 7D + 12) y(t) = (D + 2)x(t) 


2.5.2 


2.5.3 


2.5.4 


2.5.5 


2.6.1 


2.6.2 


2.6.3 


2.6.4 


2.6.5 


for initial conditions of ¥(0*) = 1 
and input x(t) of 

a. u(t) 

b. e7'u(t) 

c. e tu(t) 


Using the classical method, solve 
(D? + 6D + 25)y(t) = (D + 3)x(t) 


for the initial conditions of y(0*) = 0, y(0*) =Z and input x(t) = u(t). 


Using the classical method, solve 
(D? + 4D + 4)y(t) = (D + I)x(t) 


for initial conditions of ¥(0*) = of 
a. e u(t) 
b. e fu(t) 


Using the classical method, solve 


(D? + 2D) y(t) = (D + Dx(t) 
for initial conditions of Y(O") = 1. 


Repeat Prob. 2.5-1 for the input 
x(t) =e u(t) 


Explain, with reasons, whether the LTIC systems described by the following equations are (i) stable or unstable in the BIBO sense; (ii) 
asymptotically stable, unstable, or marginally stable. Assume that the systems are controllable and observable. 


a. (D2 + 8D + 12)y(t) = (D — 1)x(t) 
b. D(D2 + 3D + 2)y(t) = (D + 5)x(t) 
c. D2(D? + 2)y(t) = x(t) 
d. (D + 1)(D?2 — 6D + 5)y(t) = (3 D + 1)x(t) 
Repeat Prob. 2.6-1 for the following. 
a. (D + 1)(D2 + 2D + 5)*y(t) = x(t) 
b. (D + 1)(D2 + 9)y(t) = (2D + 9)x(t) 
c. (D + 1)(D2 + 9)? y(t) = (2D + 9)x(t) 
d. (D2 + 1)(D2 + 4)(D2 + 9)y(t) = 3Dx(t) 
For a certain LTIC system, the impulse response h(t) = u(t). 
a. Determine the characteristic root(s) of this system. 
b. Is this system asymptotically or marginally stable, or is it unstable? 
c. Is this system BIBO stable? 
d. What can this system be used for? 


In Section 2.6 we demonstrated that for an LTIC system, condition (2.64) is sufficient for BIBO stability. Show that this is also a 
necessary condition for BIBO stability in such systems. In other words, show that if condition (2.64) is not satisfied, then there exists a 
bounded input that produces an unbounded output. [Hint: Assume that a system exists for which h(t) violates condition (2.64) and yet 
produces an output that is bounded for every bounded input. Establish the contradiction in this statement by considering an input x(t) 
defined by x(t; — T) = 1 when A(T) = O and x(t, — T) = — 1 when h(T) < 0, where f, is some fixed instant.] 


An analog LTIC system with impulse response function h(t) = u(t + 2) — u(t — 2) is presented with an input x(t) = t(u(t) — u(t — 2)). 
a. Determine and plot the system output y(t) = x(t) * A(t). 


b. Is this system stable? Is this system causal? Justify your answers. 


2.6.6 


2.6.7 


2.7.1 


2.7.2 


2.7.3 


2.7.4 


A system has an impulse response function shaped like a rectangular pulse, h(t) = u(t) — u(t — 1). Is the system stable? Is the 
system causal? 


A continuous-time LTI system has impulse response function A(t) = X” j=9(0.5)/00 (t—i). 
a. Is the system causal? Prove your answer. 


b. Is the system stable? Prove your answer. 


Data at a rate of 1 million pulses per second are to be transmitted over a certain communications channel. The unit step response g(t) 
for this channel is shown in Fig. P2.7-1. 


a. Can this channel transmit data at the required rate? Explain your answer. 


b. Can an audio signal consisting of components with frequencies up to 15 kHz be transmitted over this channel with 
reasonable fidelity? 


Figure P2.7-1 
A certain communication channel has a bandwidth of 10 kHz. A pulse of 0.5 ms duration is transmitted over this channel. 
a. Determine the width (duration) of the received pulse. 


b. Find the maximum rate at which these pulses can be transmitted over this channel without interference between the 
successive pulses. 


A first-order LTIC system has a characteristic root \ = — 104. 
a. Determine T,, the rise time of its unit step input response. 
b. Determine the bandwidth of this system. 
c. Determine the rate at which the information pulses can be transmitted through this system. 
Consider a linear, time-invariant system with impulse response h(t) shown in Fig. P2.7-4. Outside the interval shown, h(t) = 0. 


a. What is the rise time 7, of this system? Remember, rise time is the time between the application of a unit step and the 
moment at which the system has "fully" responded. 


b. Suppose h(t) represents the response of a communication channel. What conditions might cause the channel to have 
such an impulse response? What is the maximum average number of pulses per unit time that can be transmitted without 
causing interference? Justify your answer. 


c. Determine the system output y(t) = x(t) * A(t) for x(t) = [u(t — 2) — u(t)]. Accurately sketch y(t) over (0 < t < 10). 
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Figure P2.7-4: Impulse responseh(f). 


Chapter 3: Time-Domain Analysis of Discrete-Time Systems 


In this chapter we introduce the basic concepts of discrete-time signals and systems. We shall study convolution method of analysis of linear, time- 
invariant, discrete-time (LTID) systems. Classical methods of analysis of these systems will also be examined. 


3.1 INTRODUCTION 


Discrete-time signal is basically a sequence of numbers. Such signals arise naturally in inherently discrete-time situations such as population 
studies, amortization problems, national income models, and radar tracking. They may also arise as a result of sampling continuous-time signals in 
sampled data systems and digital filtering. Such signals can be denoted by x[n], y[n], and so on, where the variable n takes integer values, and 
X[n] denotes the nth number in the sequence labeled x. In this notation, the discrete-time variable n is enclosed in square brackets instead of 
parentheses, which we have reserved for enclosing continuous-time variable, such as t. 


Systems whose inputs and outputs are discrete-time signals are called discrete-time systems. A digital computer is a familiar example of this type of 
system. A discrete-time signal is a sequence of numbers, and a discrete-time system processes a sequence of numbers x[n] to yield another 
sequence y[n] as the output!) 

A discrete-time signal, when obtained by uniform sampling of a continuous-time signal x(t), can also be expressed as x(nT), where T is the 
sampling interval and n, the discrete variable taking on integer values. Thus, x(n7) denotes the value of the signal x(t) at f= nT. The signal x(nT) 


is a sequence of numbers (sample values), and hence, by definition, is a discrete-time signal. Such a signal can also be denoted by the customary 
discrete-time notation x[n], where x[n] = x(nT). A typical discrete-time signal is depicted in Fig. 3.1, which shows both forms of notation. By way of 


an example, a continuous-time exponential x(t) = e! when sampled every T= 0.1 second, results in a discrete-time signal x(nT) given by 
x(nT) = e7*T = en ola 


x[n] | or x(nT) 
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Figure 3.1: A discrete-time signal. 


Clearly, this signal is a function of n and may be expressed as x[n]. Such representation is more convenient and will be followed throughout this 
book even for signals resulting from sampling continuous-time signals. 


Digital filters, can process continuous-time signals by discrete-time systems, using appropriate interfaces at the input and the output, as illustrated 
in Fig. 3.2. A continuous-time signal x(t) is first sampled to convert it into a discrete-time signal x[n], which is then processed by a discrete-time 
system to yield the output y[n]. A continuous-time signal y(t) is finally constructed from y[n]. We shall use the notations C/D and D/C for 
conversion from continuous to discrete-time and from discrete to continuous time. By using the interfaces in this manner, we can use an appropriate 
discrete-time system to process a continuous-time signal. As we shall see later in our discussion, discrete-time systems have several advantages 
over continuous-time systems. For this reason, there is an accelerating trend toward processing continuous-time signals with discrete-time systems. 
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Figure 3.2: Processing a continuous-time signal by means of a discrete-time system. 


3.1-1 Size of a Discrete-Time Signal 


Arguing along the lines similar to those used for continuous-time signals, the size of a discrete-time signal x[n] will be measured by its energy Ey, 
defined by 


oO 


E,= >> Ixini? (3.1) 
a=-—0o 
This definition is valid for real or complex x[n]. For this measure to be meaningful, the energy of a signal must be finite. A necessary condition for 
the energy to be finite is that the signal amplitude must — 0 as |n| — oo. Otherwise the sum in Eq. (3.1) will not converge. If E, is finite, the signal 
is called an energy signal. 


In some cases, for instance, when the amplitude of x[n] does not — 0 as |n| — o, then the signal energy is infinite, and a more meaningful 
measure of the signal in such a case would be the time average of the energy (if it exists), which is the signal power Py, defined by 


P, = Jim = —— — Sia? (3.2) 


In this equation, the sum is divided by 2N + 1 because there are 2N + 1 samples in the interval from - N to N. For periodic signals, the time 
averaging need be performed over only one period in view of the periodic repetition of the signal. If P, is finite and nonzero, the signal is called a 


power signal. As in the continuous-time case, a discrete-time signal can either be an energy signal or a power signal, but cannot be both at the 
same time. Some signals are neither energy nor power signals. 


EXAMPLE 3.1 
Find the energy of the signal x[n] = n, shown in Fig. 3.3a and the power for the periodic signal y[n] in Fig. 3.3b. 
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(b) 
Figure 3.3: (a) Energy and (b) power computation for a signal. 
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aii = 55 


a0 
A periodic signal x[n] with period No is characterized by the fact that 
x[n] = xIn + Nol 


The smallest value of No for which the preceding equation holds is the fundamental period. Such a signal is called No periodic. Figure 3.3b shows 
an example of a periodic signal y[n] of period Ng = 6 because each period contains 6 samples. Note that if the first sample is taken at n = 0, the 
last sample is at n = No — 1 = 5, not at n = No = 6. Because the signal y[n] is periodic, its power Py can be found by averaging its energy over 
one period. Averaging the energy over one period, we obtain 


15... 55 


EXERCISE E3.1 
Show that the signal x[n] = a” u[n] is an energy signal of energy E, = 1/(1 — lal?) if |a| < 1. It is a power signal of power Py, = 0.5 if |a] = 1. It is 
neither an energy signal nor a power signal if |a| > 1. 


[tlThere may be more than one input and more than one output. 


3.2 USEFUL SIGNAL OPERATIONS 


Signal operations for shifting, and scaling, as discussed for continuous-time signals also apply to discrete-time signals with some modifications. 


SHIFTING 


Consider a signal x[n] (Fig. 3.4a) and the same signal delayed (right-shifted) by 5 units (Fig. 3.4b), which we shall denote by x, [n]. {11 Using the 
argument employed for a similar operation in continuous-time signals (Section 1.2), we obtain 


x,[n] = x[n — 5] 
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Figure 3.4: Shifting and time reversal of a signal. 


Therefore, to shift a sequence by M units (M integer), we replace n with n — M. Thus x[n — M] represents x[n] shifted by M units. If M is positive, 
the shift is to the right (delay). If M is negative, the shift is to the left (advance). Accordingly, x[n — 5] is x[n] delayed (right-shifted) by 5 units, and 
x[n + 5] is x[n] advanced (left-shifted) by 5 units. 


TIME REVERSAL 

To time-reverse x[n] in Fig. 3.4a, we rotate x[n] about the vertical axis to obtain the time reversed signal x,[n] shown in Fig. 3.4c. Using the 
argument employed for a similar operation in continuous-time signals (Section 1.2), we obtain 

x-[n] = x[—n] 

Therefore, to time-reverse a signal, we replace n with — n so that x[—n] is the time reversed x[n]. For example, if x[n] = (0.9)"" for 3 < n < 10, 
then x,[n] = (0.9)"" for 3 < —n < 10; that is, -3 < n < —10, as shown in Fig. 3.4c. 


The origin n = 0 is the anchor point, which remains unchanged under time-reversal operation because at n = 0, x[n] = x[—n] = x[0]. Note that while 
the reversal of x[n] about the vertical axis is x[—n], the reversal of x[n] about the horizontal axis is —x[n]. 


EXAMPLE 3.2 
In the convolution operation, discussed later, we need to find the function x[k — n] from x[n]. 


This can be done in two steps: (i) time-reverse the signal x[n] to obtain x[—n]; (ii) now, right-shift x[—n] by k. Recall that right-shifting is 
accomplished by replacing n with n — k. Hence, right-shifting x[—n]by k units is x[—(n—k] = x[k—n]. Figure 3.4d shows x[5 — n], obtained this 
way. We first time-reverse x[n] to obtain x[—n] in Fig. 3.4c. Next, we shift x[—n] by k = 5 to obtain x[k — n] = x[5 — nj, as shown in Fig. 3.4d. 


In this particular example, the order of the two operations employed is interchangeable. We can first left-shift x[k] to obtain x[n + 5]. Next, we time- 
reverse x[n + 5] to obtain x[—/n + 5] = x[5 —n]. The reader is encouraged to verify that this procedure yields the same result, as in Fig. 3.4d. 


SAMPLING RATE ALTERATION: DECIMATION AND INTERPOLATION 


Alteration of the sampling rate is somewhat similar to time-scaling in continuous-time signals. Consider a signal x[n] compressed by factor M. 
Compressing a signal x[n] by factor M yields xg[n] given by 


xa[n] = x[Mn] (3,3) 


Because of the restriction that discrete-time signals are defined only for integer values of the argument, we must restrict M to integer values. The 
values of x[Mn] at n = 0, 1, 2, 3,... are x[O], x[M], x[2M], x[3M],.... This means x[Mn] selects every Mth sample of x[n] and deletes all the samples 
in between. For this reason, this operation is called decimation. It reduces the number of samples by factor M. If x[n] is obtained by sampling a 
continuous-time signal, this operation implies reducing the sampling rate by factor M. For this reason, decimation is also called downsampling. 


Figure 3.5a shows a signals x[n] and Fig. 3.5b shows the signal x[2n], which is obtained by deleting odd numbered samples of x[n].{71 
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Figure 3.5: Compression (decimation) and expansion (interpolation) of a signal. 


In the continuous-time case, time compression merely speeds up the signal without loss of any data. In contrast, decimation of x[n] generally 
causes loss of data. Under certain conditions-for example, if x[n] is the result of oversampling some continuous-time signal-then xg[n] may still 
retain the complete information about x[n]. 


An interpolated signal is generated in two steps; first, we expand x[n] by an integer factor L to obtain the expanded signal x,[n], as 


x[n/L] n=0, +L +22,..., 
x,[2] = { 


: (3.4) 
0 otherwise 


To understand this expression, consider a simple case of expanding x[n] by a factor 2 (L = 2). The expanded signal x,[n] = x[n/2]. When n is odd, 
n/2 is noninteger. But x[n] is defined only for integer values of n and is zero otherwise. Therefore, x,[n] = 0, for odd n, that is, xo[1] = x.[3] = 
X,[5],... are all zero, as depicted in Fig. 3.5c. Moreover, n/2 is integer for even n, and the values of x,[n] = x[n/2] for n = 0, 2, 4, 6,..., are x[0], x[1], 
X[2], x[3],..., aS shown in Fig. 3.5c. In general, for n = 0, 1, 2,..., X[N] is given by the sequence 


x[0], 0.0,...,0, 0, x[1], 0, 0,....0,0, x[2],0,0,....0,0,... 
Liz Liz Lin 


Thus, the sampling rate of x,[n] is L times that of x[n]. Hence, this operation is called expanding. The expanded signal x,[n] contains all the data 
of x[n], although in an expanded form. 


In the expanded signal in Fig. 3.5c, the missing (zero-valued) odd-numbered samples can be reconstructed from the non-zero-valued samples by 
using some suitable interpolation formula. Figure 3.5d shows such an interpolated signal x;[n], where the missing samples are constructed by using 
an interpolating filter. The optimum interpolating filter is usually an ideal lowpass filter, which is realizable only approximately. In practice, we may 
use an interpolation that is nonoptimum but realizable. Further discussion of interpolation is beyond our scope. This process of filtering to interpolate 
the zero-valued samples is called interpolation. Since the interpolated data are computed from the existing data, interpolation does not result in 
gain of information. 


EXERCISE E3.2 
Show that x[n] in Fig. 3.4a left-shifted by 3 units can be expressed as 0.729(0.9)" for 0 < n < 7, and zero otherwise. Sketch the shifted signal. 


EXERCISE E3.3 


Sketch the signal x[n] = eS foro ene 2, and zero otherwise. Sketch the corresponding time-reversed signal and show that it can be 
expressed as x,[n] = 29-5" for -2 <n <3. 


EXERCISE E3.4 
Show that x[—k — n] can be obtained from x[n] by first right-shifting x[n] by k units and then time-reversing this shifted signal. 


EXERCISE E3.5 


A signal x[n] is expanded by factor 2 to obtain signal x[n/2]. The odd-numbered samples (n odd) in this signal have zero value. Show that the 
linearly interpolated odd-numbered samples are given by x;[n] = (1/2){x[n — 1] + x[n + 1]}. 


[tlThe terms "delay" and "advance" are meaningful only when the independent variable is time. For other independent variables, such as frequency 
or distance, it is more appropriate to refer to the "right shift" and "left shift" of a sequence. 


[tlOdd-numbered samples of x[n] can be retained (and even numbered samples deleted) by using the transformation xg[n] = x[2n + 1]. 


3.3 SOME USEFUL DISCRETE-TIME SIGNAL MODELS 


We now discuss some important discrete-time signal models that are encountered frequently in the study of discrete-time signals and systems. 


3.3-1 Discrete-Time Impulse Function 8[n] 


The discrete-time counterpart of the continuous-time impulse function 8(t) is 5[n], a Kronecker delta function, defined by 


s[n] = 1 n=0 35) 
a ak 


This function, also called the unit impulse sequence, is shown in Fig. 3.6a. The shifted impulse sequence 85[n — m] is depicted in Fig. 3.6b. Unlike 
its continuous-time counterpart 8(t) (the Dirac delta), the Kronecker delta is a very simple function, requiring no special esoteric knowledge of 
distribution theory. 
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Figure 3.6: Discrete-time impulse function: (a) unit impulse sequence and (b) shifted impulse sequence. 


3.3-2 Discrete-Time Unit Step Function u[n] 


The discrete-time counterpart of the unit step function u(t) is u[n] (Fig. 3.7a), defined by 


In] {' forn >0 (3.6) 
nj= : 
0 forn < 0 


(b) 
Figure 3.7: (a) A discrete-time unit step function u[n] and (b) its application. 


If we want a signal to start at n = 0 (so that it has a zero value for all n < 0), we need only multiply the signal by u[n]. 


EXAMPLE 3.3 
Describe the signal x[n] shown in Fig. 3.7b by a single expression valid for all n. 


There are many different ways of viewing x[n]. Although each way of viewing yields a different expression, they are all equivalent. We shall 
consider here just one possible expression. 


The signal x[n] can be broken into three components: (1) a ramp component x, [n] from n = 0 to 4, (2) a step component x2[n] from n = 5 to 10, 
and (3) an impulse component x3[n] represented by the negative spike at n = 8. Let us consider each one separately. 


We express x4[n] = n(u[n] — 
3.4 EXAMPLES OF DISCRETE-TIME SYSTEMS 


We shall give here four examples of discrete-time systems. In the first two examples, the signals are inherently of the discrete-time variety. In the 
third and fourth examples, a continuous-time signal is processed by a discrete-time system, as illustrated in Fig. 3.2, by discretizing the signal 
through sampling. 


EXAMPLE 3.4: (Savings Account) 

A person makes a deposit (the input) in a bank regularly at an interval of T (say, 1 month). The bank pays a certain interest on the account 
balance during the period 7 and mails out a periodic statement of the account balance (the output) to the depositor. Find the equation relating the 
output y[n] (the balance) to the input x[n] (the deposit). 


In this case, the signals are inherently discrete time. Let 
x[n] = deposit made at the nth discrete instant 


y[2] = account balance at the nth instant computed 
immediately after receipt of the nth deposit x[7] 
r = interest per dollar per period T 


The balance y[n] is the sum of (i) the previous balance y[n — 1], (ii) the interest on y[n — 1] during the period T, and (iii) the deposit x[n] 


yl[n] = yin — 1] + ry[n — 1] + x[n] 
= (1+r)y[n — 1] +2x["] 
or 
y[n] — ay[n — 1] = x[n] a=Il1+r (3.9a) 
In this example the deposit x[n] is the input (cause) and the balance y[n] is the output (effect). 


A withdrawal from the account is a negative deposit. Therefore, this formulation can handle deposits as well as withdrawals. It also applies to a loan 
payment problem with the initial value y[0] = —M, where M is the amount of the loan. A loan is an initial deposit with a negative value. Alternately, 
we may treat a loan of M dollars taken at n = 0 as an input of —M at n = 0 (see Prob. 3.8-16). 


We can express Eq. (3.9a) in an alternate form. The choice of index n in Eq. (3.9a) is completely arbitrary, so we can substitute n + 1 for n to 
obtain 


y[n + 1] — ay[n] = x[n + 1] (3.9b) 


We also could have obtained Eq. (3.9b) directly by realizing that y[n + 1], the balance at the (n + 1)st instant, is the sum of y[n] plus ry[n] (the 
interest on y[n]) plus the deposit (input) x[n + 1] at the (n + 1)st instant. 


The difference equation in (3.9a) uses delay operation, whereas the form in Eq. (3.96) uses advance operation. We shall call the form (3.9a) the 
delay operator form and the form (3.9b) the advance operator form. The delay operator form is more natural because operation of delay is a 
causal, and hence realizable. In contrast, advance operation, being noncausal, is unrealizable. We use the advance operator form primarily for its 


mathematical convenience over the delay form.!t] 


We shall now represent this system in a block diagram form, which is basically a road map to hardware (or software) realization of the system. For 
this purpose, the causal (realizable) delay operator form in Eq. (3.9a) will be used. There are three basic operations in this equation: addition, 
scalar multiplication, and delay. Figure 3.11 shows their schematic representation. In addition, we also have a pickoff node (Fig. 3.11d), which is 
used to provide multiple copies of a signal at its input. 
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Figure 3.11: Schematic representations of basic operations on sequences. 


Equation (3.9a) can be rewritten as 
y[n] = ay[n — 1] + x[n] a=Il14r (3.9c) 


Figure 3.12 shows in block diagram form a system represented by Eq. (3.9c). To understand this realization, assume that the output y[n] is 
available at the pickoff node N. Unit delay of y[n] results in y[n — 1], which is multiplied by a scalar of value a to yield ay[n — 1]. Next, we generate 


y[n] by adding the input x[n] and ay[n — 1] according to Eq. (3.9c). [4] Observe that the node N is a pickoff node, from which two copies of the 
output signal flow out; one as the feedback signal, and the other as the output signal. 
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Figure 3.12: Realization of the savings account system. 


EXAMPLE 3.5: (Sales Estimate) 

In an nth semester, x[n] students enroll in a course requiring a certain textbook. The publisher sells y[n] new copies of the book in the nth 
semester. On the average, one-quarter of students with books in salable condition resell the texts at the end of the semester, and the book life is 
three semesters. Write the equation relating y[n], the new books sold by the publisher, to x[n], the number of students enrolled in the nth semester, 
assuming that every student buys a book. 


In the nth semester, the total books x[n] sold to students must be equal to y[n] (new books from the publisher) plus used books from students 
enrolled in the preceding two semesters (because the book life is only three semesters). There are y[n — 1] new books sold in the (n — 1)st 
semester, and one-quarter of these books, that is, (1/4)y[n — 1], will be resold in the nth semester. Also, y[n — 2] new books are sold in the (n — 
2)nd semester, and one-quarter of these, that is, (1/4)y[n — 2], will be resold in the (n — 1)st semester. Again a quarter of these, that is, (1/16)y[n 
— 2], will be resold in the nth semester. Therefore, x[n] must be equal to the sum of y[n], (1/4)y[n — 1], and (1/16)y[n — 2]. 


y[nj + ty[n —1)+ sayin — 2) =x] (3.10a) 


Equation (3.10a) can also be expressed in an alternative form by realizing that this equation is valid for any value of n. Therefore, replacing n by n + 
2, we obtain 


yin + 2) + tyln +1) + dyln) = xn + 2] (3.10b) 
This is the alternative form of Eq. (3.10a). 


For a realization of a system with this input-output equation, we rewrite the delay form Eq. (3.10a) as 


yin} = —tyln — 1) — dyln — 2) + 2ln) (3.10¢) 


Figure 3.13 shows a hardware realization of Eq. (3.10c) using two unit delays in cascade. It] 
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Figure 3.13: Realization of the system representing sales estimate in Example 3.5. 


EXAMPLE 3.6: (Digital Differentiator) 
Design a discrete-time system, like the one in Fig. 3.2, to differentiate continuous-time signals. This differentiator is used in an audio system having 
an input signal bandwidth below 20 kHz. 


In this case, the output y(t) is required to be the derivative of the input x(t). The discrete-time processor (system) G processes the samples of x(t) 
to produce the discrete-time output y[n]. Let x[n] and y[n] represent the samples T seconds apart of the signals x(t) and y(t), respectively, that is, 


x[n] = x(nT) and y[n] = y(nT) (3.11) 
The signals x[n] and y[n] are the input and the output for the discrete-time system G. Now, we require that 
dx 
y(t) = ae 
Therefore, at f = nT (see Fig. 3.14a) 
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Figure 3.14: Digital differentiator and its realization. 
By using the notation in Eq. (3.11), the foregoing equation can be expressed as 
1 
yin] = lim —{x|[n] —x|n -1 
yla} = tim ={xln] — xn — 1} 
This is the input-output relationship for G required to achieve our objective. In practice, the sampling interval T cannot be zero. Assuming T to be 


sufficiently small, the equation just given can be expressed as 


y[n] = A (x10 —x[a — 1]} (3.12) 


The approximation improves as T approaches 0. A discrete-time processor G to realize Eq. (3.12) is shown inside the shaded box in Fig. 3.14b. 
The system in Fig. 3.14b acts as a differentiator. This example shows how a continuous-time signal can be processed by a discrete-time system. 
The considerations for determining the sampling interval T are discussed in Chapters 5 and 8, where it is shown that to process frequencies below 
20 kHz, the proper choice is 


1 1 
2 x highest frequency ~ 40,000 


To see how well this method of signal processing works, let us consider the differentiator in Fig. 3.14b with a ramp input x(t) = t, depicted in Fig. 
3.14c. If the system were to act as a differentiator, then the output y(t) of the system should be the unit step function u(t). Let us investigate how 
the system performs this particular operation and how well the system achieves the objective. 


re< = 25 ps 


The samples of the input x(t) = tf at the interval of T seconds act as the input to the discrete-time system G. These samples, denoted by a compact 
notation x[n], are, therefore, 
X[2)=xXOhanr =th-wr 1 20 


=nTl n>Q 


Figure 3.14d shows the sampled signal x[n]. This signal acts as an input to the discrete-time system G. Figure 3.14b shows that the operation of G 
consists of subtracting a sample from the preceding (delayed) sample and then multiplying the difference with 1/7. From Fig. 3.14d, it is clear that 
the difference between the successive samples is a constant nT — (n — 1)T = T for all samples, except for the sample at n = 0 (because there is 
no preceding sample at n = 0). The output of G is 1/T times the difference 7, which is unity for all values of n, except n = 0, where it is zero. 
Therefore, the output y[n] of G consists of samples of unit values for n = 1, as illustrated in Fig. 3.14e. The D/C (discrete-time to continuous-time) 
converter converts these samples into a continuous-time signal y(t), as shown in Fig. 3.14f. Ideally, the output should have been y(t) = u(t). This 
deviation from the ideal is due to our use of a nonzero sampling interval 7. As T approaches zero, the output y(t) approaches the desired output 
u(t). 


The digital differentiator in Eq. (3.12) is an example of what is known as the backward difference system. The reason for calling it so is obvious 
from Fig. 3.14a. To compute the derivative of y(t), we are using the difference between the present sample value and the preceding (backward) 
sample value. If we use the difference between the next (forward) sample at f = (n + 1)T and the present sample at t = n7, we obtain the forward 
difference form of differentiator as 


y[nj = “(xin + 1] — x[n]} (3.13) 


EXAMPLE 3.7: (Digital Integrator) 
Design a digital integrator along the same lines as the digital differentiator in Example 3.6. 


For an integrator, the input x(t) and the output y(t) are related by 


i 
y(t) =| x(t)dt 


Therefore, at f = nT (see Fig. 3.14a) 
Qn 


y(nT) = lim X(kT )T 
tl oe 


Using the usual notation x(kT) = x[k], y(nT) = y[n], and so on, this equation can be expressed 
n 
y[n] = lim T 2: x[k] 
=-oo 


Assuming that T is small enough to justify the assumption T — 0, we have 


yinJ=T S> xk) (3.14a) 


k=—00 


This equation represents an example of accumulator system. This digital integrator equation can be expressed in an alternate form. From Eq. 
(3.14a), it follows that 


y[n] — y[n — 1] = Tx[n] (3.14b) 


This is an alternate description for the digital integrator. Equations (3.14a) and (3.14b) are equivalent; the one can be derived from the other. 
Observe that the form of Eq. (3.14b) is similar to that of Eq. (3.9a). Hence, the block diagram representation of the digital differentiator in the form 
(3.14b) is identical to that in Fig. 3.12 with a = 1 and the input multiplied by T. 


RECURSIVE AND NONRECURSIVE FORMS OF DIFFERENCE EQUATION 

If Eq. (3.14b) expresses Eq. (3.14a) in another form, what is the difference between these two forms? Which form is preferable? To answer these 
questions, let us examine how the output is computed by each of these forms. In Eq. (3.14a), the output y[n] at any instant n is computed by 
adding all the past input values till n. This can mean a large number of additions. In contrast, Eq. (3.14b) can be expressed as y[n] = y[n — 1] + 
Tx[n]. Hence, computation of y[n] involves addition of only two values; the preceding output value y[n — 1] and the present input value x[n]. The 
computations are done recursively by using the preceding output values. For example, if the input starts at n = 0, we first compute y[0]. Then we 
use the computed value y[0] to compute y[1]. Knowing y[1], we compute y[2], and so on. The computations are recursive. This is why the form 
(3.14b) is called recursive form and the form (3.14a) is called nonrecursive form. Clearly, "recursive" and "nonrecursive" describe two different ways 
of presenting the same information. Equations (3.9), (3.10), and (3.14b) are examples of recursive form, and Eqs. (3.12) and (3.14a) are examples 
of nonrecursive form. 


KINSHIP OF DIFFERENCE EQUATIONS TO DIFFERENTIAL EQUATIONS 
We now show that a digitized version of a differential equation results in a difference equation. Let us consider a simple first-order differential 
equation 


— +cy(t) = x(t) (3.15a) 
dt 
Consider uniform samples of x(t) at intervals of T seconds. As usual, we use the notation x[n] to denote x(nT), the nth sample of x(t). Similarly, 
y[n] denotes y[nT], the nth sample of y(t). From the basic definition of a derivative, we can express Eq. (3.15a) at f= nT as 
_ y[nj—y[n -— 1] 
lim ———————_ cy [[n] = x[n] 
T+0 fi . 


Clearing the fractions and rearranging the terms yields (assuming nonzero, but very small 7) 


y[n] + ay[n — 1] = Ax[n] (3.15b) 
where 
—1 T 
= and => ——_ 
wer P= et 
We can also express Eq. (3.15b) in advance operator form as 
y[n + 1] + ay[n] = Ax[n + 1] (3.15c) 


It is clear that a differential equation can be approximated by a difference equation of the same order. In this way, we can approximate an nth-order 
differential equation by a difference equation of nth order. Indeed, a digital computer solves differential equations by using an equivalent difference 
equation, which can be solved by means of simple operations of addition, multiplication, and shifting. Recall that a computer can perform only these 
simple operations. It must necessarily approximate complex operation like differentiation and integration in terms of such simple operations. The 
approximation can be made as close to the exact answer as possible by choosing sufficiently small value for T. 


At this stage, we have not developed tools required to choose a suitable value of the sampling interval T. This subject is discussed in Chapter 5 
and also in Chapter 8. In Section 5.7, we shall discuss a systematic procedure (impulse invariance method) for finding a discrete-time system with 
which to realize an Nth-order LTIC system. 


ORDER OF A DIFFERENCE EQUATION 

Equations (3.9), (3.10), (3.13), (3.14b), and (3.15) are examples of difference equations. The highest-order difference of the output signal or the 
input signal, whichever is higher represents the order of the difference equation. Hence, Eqs. (3.9), (3.13), (3.14b), and (3.15) are first-order 
difference equations, whereas Eq. (3.10) is of the second order. 


EXERCISE E3.8 


Design a digital integrator in Example 3.7 using the fact that for an integrator, the output y(t) and the input x(t) are related by dy/dt = x(t). 
Approximation (similar to that in Example 3.6) of this equation at t = nT yields the recursive form in Eq. (3.14b). 


ANALOG, DIGITAL, CONTINUOUS-TIME, AND DISCRETE-TIME SYSTEMS 


The basic difference between continuous-time systems and analog systems, as also between discrete-time and digital systems, is fully explained in 


Sections 1.7-5 and 1.7-6.[T1 Historically, discrete-time systems have been realized with digital computers, where continuous-time signals are 
processed through digitized samples rather than unquantized samples. Therefore, the terms digital filters and discrete-time systems are used 
synonymously in the literature. This distinction is irrelevant in the analysis of discrete-time systems. For this reason, we follow this loose convention 
in this book, where the term digital filter implies a discrete-time system, and analog filter means continuous-time system. Moreover, the terms C/D 
(continuous-to-discrete-time) and D/C will occasionally be used interchangeably with terms A/D (analog-to-digital) and D/A, respectively. 


ADVANTAGES OF DIGITAL SIGNAL PROCESSING 


1. Digital systems operation can tolerate considerable variation in signal values, and, hence, are less sensitive to changes in the 
component parameter values caused by temperature variation, aging and other factors. This results in greater degree of precision and 
stability. Since they are binary circuits, their accuracy can be increased by using more complex circuitry to increase word length, 
subject to cost limitations. 


2. Digital systems do not require any factory adjustment and can be easily duplicated in volume without having to worry about precise 
component values. They can be fully integrated, and even highly complex systems can be placed on a single chip by using VLS/ 
(very-large-scale integrated) circuits. 


3. Digital filters are more flexible. Their characteristics can be easily altered simply by changing the program. Digital hardware 
implementation permits the use of microprocessors, miniprocessors, digital switching, and large-scale integrated circuits. 


4. A greater variety of filters can be realized by digital systems. 


5. Digital signals can be stored easily and inexpensively on magnetic tapes or disks without deterioration of signal quality. It is also 
possible to search and select information from distant electronic storehouses. 


6. Digital signals can be coded to yield extremely low error rates and high fidelity, as well as privacy. Also, more sophisticated signal 
processing algorithms can be used to process digital signals. 


7. Digital filters can be easily time-shared and therefore can serve a number of inputs simultaneously. Moreover, it is easier and more 
efficient to multiplex several digital signals on the same channel. 


8. Reproduction with digital messages is extremely reliable without deterioration. Analog messages such as photocopies and films, for 
example, lose quality at each successive stage of reproduction and have to be transported physically from one distant place to 
another, often at relatively high cost. 


One must weigh these advantages against such disadvantages, as increased system complexity due to use of A/D and D/A interfaces, 
limited range of frequencies available in practice (about tens of megahertz), and use of more power than is needed for the passive 
analog circuits. Digital systems use power-consuming active devices. 


3.4-1 Classification of Discrete-Time Systems 


Before examining the nature of discrete-time system equations, let us consider the concepts of linearity, time invariance (or shift invariance), and 
causality, which apply to discrete-time systems also. 


LINEARITY AND TIME INVARIANCE 


For discrete-time systems, the definition of linearity is identical to that for continuous-time systems, as given in Eq. (1.40). We can show that the 
systems in Examples 3.4, 3.5, 3.6, and 3.7 are all linear. 


Time invariance (or shift invariance) for discrete-time systems is also defined in a way similar to that for continuous-time systems. Systems whose 
parameters do not change with time (with n) are time-invariant or shift-invariant (also constant-parameter) systems. For such a system, if the input 
is delayed by k units or samples, the output is the same as before but delayed by k samples (assuming the initial conditions also are delayed by k). 
Systems in Examples 3.4, 3.5, 3.6, and 3.7 are time invariant because the coefficients in the system equations are constants (independent of n). If 
these coefficients were functions of n (time), then the systems would be linear time-varying systems. Consider, for example, a system described by 
y[n] = e"x[n] 


For this system, let a signal x4[n] yield the output y;[n], and another input xz[n] yield the output y2[n]. Then 
yiln] = e "x In] and y2[a] = e"x2[n] 


If we let xo[n] = x4[n — No], then 


yo[n] = e"x2[n] = ex, [2 — No] # yiln — No] 
Clearly, this is a time-varying parameter system. 


CAUSAL AND NONCAUSAL SYSTEMS 

A causal (also known as a physical or nonanticipative) system is one for which the output at any instant n = k depends only on the value of the 
input x[n] for n < k. In other words, the value of the output at the present instant depends only on the past and present values of the input x[n], 
not on its future values. As we shall see, the systems in Examples 3.4, 3.5, 3.6, and 3.7 are all causal. 


INVERTIBLE AND NONINVERTIBLE SYSTEMS 

A discrete-time system S is invertible if an inverse system S; exists such that the cascade of S and S; results in an identity system. An identity 
system is defined as one whose output is identical to the input. In other words, for an invertible system, the input can be uniquely determined from 
the corresponding output. For every input there is a unique output. When a signal is processed through such a system, its input can be 
reconstructed from the corresponding output. There is no loss of information when a signal is processed through an invertible system. 


A cascade of a unit delay with a unit advance results in an identity system because the output of such a cascaded system is identical to the input. 
Clearly, the inverse of an ideal unit delay is ideal unit advance, which is a noncausal (and unrealizable) system. In contrast, a compressor y[n] = 
X[Mn] is not invertible because this operation loses all but every Mth sample of the input, and, generally, the input cannot be reconstructed. 
Similarly, an operations, such as, y[n] = cos x[n] or y[n] = |x[n]| are not invertible. 


EXERCISE E3.9 
Show that a system specified by equation y[n] = ax[n] + b is invertible, but the system y[n] = |x[n]|2 is noninvertible. 


STABLE AND UNSTABLE SYSTEMS 

The concept of stability is similar to that in continuous-time systems. Stability can be internal or external. If every bounded input applied at the input 
terminal results in a bounded output, the system is said to be stable externally. The external stability can be ascertained by measurements at the 
external terminals of the system. This type of stability is also known as the stability in the BIBO (bounded-input/bounded-output) sense. Both, 
internal and external stability are discussed in greater detail in Section 3.10. 


MEMORYLESS SYSTEMS AND SYSTEMS WITH MEMORY 

The concepts of memoryless (or instantaneous) systems and those without memory (or dynamic) are identical to the corresponding concepts of the 
continuous-time case. A system is memoryless if its response at any instant n depends at most on the input at the same instant n. The output at 
any instant of a system with memory generally depends on the past, present, and future values of the input. For example, y[n] = sin x[n] is an 
example of instantaneous system, and y[n] — y[n — 1] = x[n] is an example of a dynamic system or a system with memory. 


[tlUse of the advance operator form results in discrete-time system equations that are identical in form to those for continuous-time systems. This 
will become apparent later. In the transform analysis, use of the advance operator permits the use of more convenient variable z instead of the 


clumsy z~' needed in the delay operator form. 


[4A unit delay represents one unit of time delay. In this example one unit of delay in the output corresponds to period T for the actual output. 


[t]lThe comments in the preceding footnote apply here also. Although one unit of delay in this example is one semester, we need not use this value 
in the hardware realization. Any value other than one semester results in a time-scaled output. 


[tlThe terms discrete-time and continuous-time qualify the nature of a signal along the time axis (horizontal axis). The terms analog and digital, in 
contrast, qualify the nature of the signal amplitude (vertical axis). 


3.5 DISCRETE-TIME SYSTEM EQUATIONS 


In this section we discuss time-domain analysis of LTID (linear time-invariant, discrete-time systems). With minor differences, the procedure is 
parallel to that for continuous-time systems. 


DIFFERENCE EQUATIONS 
Equations (3.9), (3.10), (3.12), and (3.15) are examples of difference equations. Equations (3.9), (3.12), and (3.15) are first-order difference 


equations, and Eq. (3.10) is a second-order difference equation. All these equations are linear, with constant (not time-varying) coefficients. [1] 
Before giving a general form of an Nth-order linear difference equation, we recall that a difference equation can be written in two forms; the first 
form uses delay terms such as y[n — 1], y[n — 2], x[n — 1], x[n — 2], and so on, and the alternate form uses advance terms such as y[n + 1], y[n 
+ 2], and so on. Although the delay form is more natural, we shall often prefer the advance form, not just for the general notational convenience, 
but also for resulting notational uniformity with the operational form for differential equations. This facilitates the commonality of the solutions and 
concepts for continuous-time and discrete-time systems. 


We start here with a general difference equation, using the advance operator form 
yin + N] + ayy[n + N = 1] +--+ + ay iyyla + 1) + ayylal = by_yaxtn + M] 
+ Dyes x[a + M — Ute + by alan + 1) + dyin] (3.16) 


This is a linear difference equation whose order is Max(N, M). We have assumed the coefficient of y[n + N] to be unity (a9 = 1) without loss of 
generality. If ag + 1, we can divide the equation throughout by ag to normalize the equation to have ao = 1. 


CAUSALITY CONDITION 


For a causal system the output cannot depend on future input values. This means that when the system equation is in the advance operator form 
(3.16), the causality requires M < N. lf M were to be greater than N, then y[n + N], the output at n + N would depend on x[n + M], which is the 
input at the later instant n + M. For a general causal case, M = N, and Eq. (3.16) can be expressed as 


yn +N] +a,y[n + N — 1+ + ay y[n + 1] + ayy[n] = box[n + N] 
+b xin} N — 1) t+) + bwiixla + 1) + bw xia] (3.17a) 


where some of the coefficients on either side can be zero. In this Nth-order equation, a9, the coefficient of y[n + NJ, is normalized to unity. 
Equation (3.17a) is valid for all values of n. Therefore, it is still valid if we replace n by n — N throughout the equation [see Eqs. (3.9a) and (3.9b)]. 
Such replacement yields the alternative form (the delay operator form) of Eq. (3.17a): 


yin] + ayy[a — I +--+ + ay iy[n — N + 1] + ayy[n — N] = box[n] 
+byxin — Ute: + by ixla — N + 11+ bexin — NI G.17b) 


3.5-1 Recursive (Iterative) Solution of Difference Equation 


Equation (3.17b) can be expressed as 


y[n] = —a,y[n — 1] — any[n — 2] -—ayy[n — N] 
+ boxin] + byxla — 1] +--+ +bxxIn — N] (3.17¢) 


In Eq. (3.17c), y[n] is computed from 2N + 1 pieces of information; the preceding N values of the output: y[n - 1], y[n - 2], ..., yin — N], and the 
preceding N values of the input: x[n — 1], x[n — 2], ..., x[n — N], and the present value of the input x[n]. Initially, to compute y[0], the N initial 
conditions y[-1], y[-2],..., yi—N] serve as the preceding N output values. Hence, knowing the N initial conditions and the input, we can determine 
the entire output y[0], y[1], y[2], y[3],...recursively, one value at a time. For instance, to find y[0] we set n = 0 in Eq. (3.17c). The left-hand side is 
y[0], and the right-hand side is expressed in terms of N initial conditions y[—1], y[-2],..., yi—N] and the input x[0] if x[n] is causal (because of 
causality, other input terms x[—n] = 0). Similarly, knowing y[0] and the input, we can compute y[1] by setting n = 1 in Eq. (3.17c). Knowing y[0] and 
y[1], we find y[2], and so on. Thus, we can use this recursive procedure to find the complete response y{0], y[1], y[2],.... For this reason, this 
equation is classed as a recursive form. This method basically reflects the manner in which a computer would solve a recursive difference equation, 
given the input and initial conditions. Equation (3.17) is nonrecursive if all the N - 1 coefficients a; = 0 (i= 1,2,..., N — 1). In this case, it can be 
seen that y[n] is computed only from the input values and without using any previous outputs. Generally speaking, the recursive procedure applies 
only to equations in the recursive form. The recursive (iterative) procedure is demonstrated by the following examples. 


EXAMPLE 3.8 
Solve iteratively 


y[n] — 0.5y[n — 1] = x[n] (3.18a) 


with initial condition y[— 1] = 16 and causal input x[n] = n? (starting at n = 0). This equation can be expressed as 


y[n] = 0.5y[n — 1] + x[n] (3.18b) 


If we set n = 0 in this equation, we obtain 


y[0] = 0.5y[—1] + x0] 
= 0.5(16) +0 =8 


Now, setting n = 1 in Eq. (3.18b) and using the value y[0] = 8 (computed in the first step) and x[1] = (1)? = 1, we obtain 
, 
yl1] = 0.5(8) + 1)" =5 


Next, setting n = 2 in Eq. (3.18b) and using the value y[1] = 5 (computed in the previous step) and x[2] = (2), we obtain 
y[2] = 0.5(5) + (2)? = 6.5 


Continuing in this way iteratively, we obtain 


y[3] = 0.5(6.5) + (3)? = 12.25 
y[4] = 0.5(12.25) + (4)? = 22.125 


The output y[n] is depicted in Fig. 3.15. 


12.25 
6.5 
eee 
_ — —+- + 
2 3 4 sao 


Figure 3.15: Iterative solution of a difference equation. 


We now present one more example of iterative solution-this time for a second-order equation. The iterative method can be applied to a difference 
equation in delay or advance operator form. In Example 3.8 we considered the former. Let us now apply the iterative method to the advance 
operator form. 


EXAMPLE 3.9 
Solve iteratively 


y[n + 2] — y[n + 1) + 0.24y[n] = x[n + 2] — 2x[n + 1] (3.19) 
with initial conditions y[—1] = 2, yi—2] = 1 and a causal input x[n] = n (starting at n = 0). The system equation can be expressed as 
y[n + 2] = y[n + 1] — 0.24y[n] + x[n + 2] — 2x[n + 1) (3.20) 


Setting n = —2 and then substituting y[—1] = 2, y[—2] = 1, x[0] = x[—1] = 0 (recall that x[n] = n starting at n = 0), we obtain 
y[0] = 2 — 0.24(1) +0 —0 = 1.76 


Setting n = —1 in Eq. (3.20) and then substituting y[0] = 1.76, y[—1] = 2, x[1] = 1, x[0] = 0, we obtain 
y[{1] = 1.76 — 0.24(2) + 1 — 0 = 2.28 


Setting n = 0 in Eq. (3.20) and then substituting y[0] = 1.76, y[1] = 2.28, x[2] = 2 and x[1] = 1 yields 
y[2] = 2.28 — 0.24(1.76) + 2 — 2(1) = 1.8576 


and so on. 


Note carefully the recursive nature of the computations. From the N initial conditions (and the input) we obtained y[0] first. Then, using this value of 
y[0] and the preceding N — 1 initial conditions (along with the input), we find y[1]. Next, using y[0], y[1] along with the past N — 2 initial conditions 
and input, we obtained y[2], and so on. This method is general and can be applied to a recursive difference equation of any order. It is interesting 
that the hardware realization of Eq. (3.18a) depicted in Fig. 3.12 (with a = 0.5) generates the solution precisely in this (iterative) fashion. 


EXERCISE E3.10 


Using the iterative method, find the first three terms of y[n] for 9 
y[n + 1] — 2y[n] = x[n] ° 


The initial condition is y[—1] = 10 and the input x[n] = 2 starting at n = 
0. 


Answers 


yfO}=20 yll]=42 = y[2] = 86 


COMPUTER EXAMPLE C3.3 
Use MATLAB to solve Example 3.9. 


>> n = (-2:10)'; y=[1;2; zeros (length(n)-2,1)]; x=[0;0;n(3:end) J; 
>> for k = 1l:length(n)-2, 
>> y(k + 2) = y(kt+1) - 0.24*y(k) + x(kt+2) - 2*x(k+1); 
>> end; 
>> clf; stem(n,y,'k'); xlabel('n'); ylabel('y[n]'); 
>> disp(' n y'); disp([num2str([n,y])]); 
n y 
-2 1 
=1 2 
0 1.76 
1 2.28 
2 1.8576 
3 0.3104 
4 -2.13542 
5 -5.20992 
6 -8.69742 
7 -12.447 
8 =16:.35997 
9 -20.3724 
10 -24.4461 
5 
0 
-5 
& -10 
Vv“ 
15 
-20 
-25 
2 0 2 4 6 8 10 
i 
Figure C3.3 


We shall see in the future that the solution of a difference equation obtained in this direct (iterative) way is useful in many situations. Despite the 
many uses of this method, a closed-form solution of a difference equation is far more useful in study of the system behavior and its dependence on 
the input and the various system parameters. For this reason we shall develop a systematic procedure to analyze discrete-time systems along lines 
similar to those used for continuous-time systems. 


OPERATIONAL NOTATION 

In difference equations it is convenient to use operational notation similar to that used in differential equations for the sake of compactness. In 
continuous-time systems we used the operator D to denote the operation of differentiation. For discrete-time systems we shall use the operator E to 
denote the operation for advancing a sequence by one time unit. Thus 


Ex[n] = x[n+ 1] 
E*x[n] = x[n +2] 


E*x[n] = xIn +N] (3.21) 
The first-order difference equation of the savings account problem was found to be [see Eq. (3.9b)] 
y[n + 1] — ay[n] = x[n + 1] (3.22) 


Using the operational notation, we can express this equation as 


Ey[n] — ay[n] = Ex[n] 


or 


(E — a)y[n] = Ex|n) (3.23) 


The second-order difference equation (3.10b) 


yin +2) + 4y[n +1] + dyn] = x[n + 2] 


can be expressed in operational notation as 


24 Pe 2 
(E7+4E£+44)y[n] = E2x[n] 
A general Nth-order difference Eq. (3.17a) can be expressed as 


(EX +a, E*-' +--- tay_.E +ay)y{n] 


= (bo EX +b EN! +--+ + bw E + bw)xin| (3.24a) 
or 
O[E]y[n] = P[E]x{[n] (3.24b) 
where Q[E] and P[E] are Nth—order polynomial operators 
OLE) = EX +a EX +--+ +anik + ay (3.25) 
PLE] = bo E* + EN! +--+ bw k + by (3.26) 


RESPONSE OF LINEAR DISCRETE-TIME SYSTEMS 

Following the procedure used for continuous-time systems, we can show that Eq. (3.24) is a linear equation (with constant coefficients). A system 
described by such an equation is a linear time-invariant, discrete-time (LTID) system. We can verify, as in the case of LTIC systems (see the 
footnote on page 152), that the general solution of Eq. (3.24) consists of zero-input and zero-state components. 


[tlEquations such as (3.9), (3.10), (3.12), and (3.15) are considered to be linear according to the classical definition of linearity. Some authors label 
such equations as incrementally linear. We prefer the classical definition. It is just a matter of individual choice and makes no difference in the final 
results. 


3.6 SYSTEM RESPONSE TO INTERNAL CONDITIONS: THE ZERO-INPUT RESPONSE 
The zero-input response yo[n] is the solution of Eq. (3.24) with x[n] = 0; that is 
O[E]y.[n] = 0 (3.27a) 
or 
(Ex +a, bE" 14. tani +ay)yoln|] = 0 (3.27b) 
or 
yoln + N] + aiyo[n + N — 1] 4 + dy_,Yoln + 1] + ayy[n] = 0 (3.27¢) 


We can solve this equation systematically. But even a cursory examination of this equation points to its solution. This equation states that a linear 
combination of yo[n] and advanced yo|[n] is zero, not for some values of n, but for all n. Such situation is possible if and only if yg[n] and advanced 


yo[n] have the same form. Only an exponential function y” has this property, as the following equation indicates. 


EX{y"} = y*** = y*y* (3.28) 


Equation (3.28) shows that y” advanced by k units is a constant (y*) times y”. Therefore, the solution of Eq. (3.27) must be of the form!T] 


yoln] = cy” (3.29) 

To determine c and y, we substitute this solution in Eq. (3.27b). Equation (3.29) yields 
E* yoln] = yoln + k] = cy"** (3.30) 

Substitution of this result in Eq. (3.27b) yields 


N-1 


cy" tay"! +--+ + aviv tan) y" =0 B31) 


For a nontrivial solution of this equation 


yN tay"! +--++an-i1y +ay =0 (3.32a) 
or 


Oly] =90 (3.32b) 


Our solution cy” [Eq. (3.29)] is correct, provided y satisfies Eq. (3.32). Now, Q[y] is an Nth—order polynomial and can be expressed in the factored 
form (assuming all distinct roots): 


(y —vn)(y — ¥2) +++ (¥ — yw) =0 (3.32c) 


Clearly, y has N solutions y;, ?2,.-.,Yn and, therefore, Eq. (3.27) also has N solutions c1y"4, C2?"9,..., CnYN. In such a case, we have shown that 
the general solution is a linear combination of the N solutions (see the footnote on page 153). Thus 


yoln] = Cry! + Coy? +++ + Cay (3.33) 


where ?4, ?9,....Ypn are the roots of Eq. (3.32) and cy, Co,..., C, are arbitrary constants determined from N auxiliary conditions, generally given in 
the form of initial conditions. The polynomial Q[y] is called the characteristic polynomial of the system, and 


Oly] =90 (3.34) 


is the characteristic equation of the system. Moreover, ?4, ?9,...,Yn, the roots of the characteristic equation, are called characteristic roots or 


characteristic values (also eigenvalues) of the system. The exponentials y”;(i = 1, 2,..., N) are the characteristic modes or natural modes of the 


system. A characteristic mode corresponds to each characteristic root of the system, and the zero-input response is a linear combination of the 
characteristic modes of the system. 


REPEATED ROOTS 


So far we have assumed the system to have N distinct characteristic roots y;, Y2,.... YN With corresponding characteristic modes y"1, ?9,.... yy. If 
two or more roots coincide (repeated roots), the form of characteristic modes is modified. Direct substitution shows that if a root y repeats r times 


(root of multiplicity r), the corresponding characteristic modes for this root are y”, ny" ,n227_.., nity", Thus, if the characteristic equation of a 
system is 


Oly] = (vy — ni)" (y — Yeas (Y — Yr42)°°* CY — YW) (3.35) 


the zero-input response of the system is 


vol] = (ey + cn + yn? + ten yf + yey teas te tae 3.36) 


COMPLEX ROOTS 


As in the case of continuous-time systems, the complex roots of a discrete-time system will occur in pairs of conjugates if the system equation 
coefficients are real. Complex roots can be treated exactly as we would treat real roots. However, just as in the case of continuous-time systems, 
we can also use the real form of solution as an alternative. 


First we express the complex conjugate roots y and y * in polar form. If |y| is the magnitude and 8 is the angle of y, then 
y=lyle® and = y*=lyle# 


The zero-input response is given by 


yoin] = cy” + c2o(y*)" 
= cly|"e" + calyl"e 
For a real system, c1 and cz must be conjugates so that yo[n] is a real function of n. Let 
Cc; Cc 
q=se” and = ae (3.37a) 


Then 


c 
yola] = silyl" [e"*" ) 4. g-i@n *] 


= cly|" cos (Bn + @) (3.37b) 


where c and @ are arbitrary constants determined from the auxiliary conditions. This is the solution in real form, which avoids dealing with complex 
numbers. 


EXAMPLE 3.10 
a. For an LTID system described by the difference equation 
y[n + 2] — 0.6y[n + 1] — 0.16y[n] = 5x[n + 2] (3.38a) 


find the total response if the initial conditions are y[—1] = 0 and y[—2] = 25/4, and if the input x[n] = 4-"u[n]. In this example we shall 
determine the zero-input component yo[n] only. The zero-state component is determined later, in Example 3.14. 


The system equation in operational notation is 
(E* — 0.6E — 0.16)y[n] = 5E°x[n] (3.38b) 
The characteristic polynomial is 


y* —0.6y — 0.16 = (y + 0.2)(y — 0.8) 


The characteristic equation is 


(vy +0.2)(y —0.8) =0 (3.39) 


The characteristic roots are y; = —0.2 and y2 = 0.8. The zero-input response is 

yon] = c,(—0.2)" + ¢2(0.8)" (3.40) 
To determine arbitrary constants c, and cz, we set n = —1 and —2 in Eq. (3.40), then substitute yo[— 1] = 0 and yo[—2] = 25/4 to 
obtain!T] 

5 1 

O=—Sc + 5c2 C= 5 
25 25 4 
FZ =25e1 + Hea C2=% 
Therefore 

yoln}] = 4(-0.2)" + 40.8)" n> 0 (3.41) 


The reader can verify this solution by computing the first few terms using the iterative method (see Examples 3.8 and 3.9). 


. A similar procedure may be followed for repeated roots. For instance, for a system specified by the equation 
2 ’ 13 . 
(E* +6E +9)y[n] = (2E* + 6E)x{[n] 
Let us determine yo[n], the zero-input component of the response if the initial conditions are yg[—1] = —1/3 and yo[—2] = —2/9. 
2 


The characteristic polynomial is yz + 6y + 9 = (y + 3)*, and we have a repeated characteristic root at y = —3. The characteristic 


modes are (—3)”" and n(—3)”. Hence, the zero-input response is 


yol] = (c, + c2:n)(-3)" 


We can determine the arbitrary constants c, and co from the initial conditions following the procedure in part (a). It is left as an 
exercise for the reader to show that c, = 4 and co = 3 so that 


yola] = (4 + 3n)(-3)" 


. For the case of complex roots, let us find the zero-input response of an LTID system described by the equation 


(E? — 1.56E + 0.81)y[n] = (E +3)x[n] 


when the initial conditions are yo[—1] = 2 and yo[—2] = 1. 


The characteristic polynomial is (y2 — 1.56y + 0.81) = (y — 0.78 — j0.45)(y — 0.78 + j0.45). The characteristic roots are 0.78 + j0.45; 
that is, 0.9e2/(T/6). We could immediately write the solution as 
yoln] = c(0.9)nei*"/6 + ¢*(0.9)ne 47" 


Setting n = —1 and —2 and using the initial conditions yo[—1] = 2 and yo[—2] = 1, we find c = 2.34e 19-17 and c* = 2.34e)9-17, 


Alternately, we could also find the solution by using the real form of solution, as given in Eq. (3.37b). In the present case, the roots 
are 0.9e*/(™/6), Hence, |y| = 0.9 and B = 11/6, and the zero-input response, according to Eq. (3.37b), is given by 


It 
yoln] = c(0.9)" cos 6" +6 


To determine the arbitrary constants c and 8, we set n = —1 and —2 in this equation and substitute the initial conditions yg[—1] = 2, 
Yo[—2] = 1 to obtain 


c xr” c | l 
2=— —-—+9)=—/— 6+ -—-sin@ 
cos ( 6° ) 09 172 cos ian 


; , 3 
l= : cos (-5 +0) = 7 tos 0+ sin 0 


3 0.81 | 2 


1 
is ccos 6 + Te osm G=m2 


1 3 
Len SP + 75 sin O='] 


These are two simultaneous equations in two unknowns c cos @ and ¢ sin 8. Solution of these equations yields 
ccos 0 = 2.308 


esin 0 = —0.397 
Dividing c sin 8 by c cos 6 yields 


-0.397 _ 0.172 
2.308 ~=—Ssd 
6 = tan '(—0.172) = —0.17 rad 
Substituting 8 = —0.17 radian in c cos 8 = 2.308 yields c = 2.34 and 


yoln] = 2.34(0.9)" cos (Zn = 0.17)n >0 


tan 0 = 


Observe that here we have used radian unit for both B and 6. We also could have used the degree unit, although this practice is not 
recommended. The important consideration is to be consistent and to use the same units for both B and 0. 


EXERCISE E3.11 


Find and sketch the zero-input response for the systems described by the following equations: 9 
a. y[n + 1] — 0.8y[n] = 3x[n + 1] 
b. y[n + 1] + 0.8y[n] = 3x[n + 1] 


In each case the initial condition is y[—1] = 10. Verify the solutions by computing the first three terms using the iterative 
method. 


Answers 


a. 8(0.8)" 


b. —8(—0.8)" 


EXERCISE E3.12 


Find the zero-input response of a system described by the equation 9) 
y[n] + 0.3y[n — 1] — 0.1 y[n — 2] = x[n] + 2x[n — 1) 7 
The initial conditions are yo[—1] = 1 and yo[—2] = 33. Verify the solution by computing the first three terms 
iteratively. 

Answers 


yo[n] = (0.2)" + 2(—0.5)" 


EXERCISE E3.13 


Find the zero-input response of a system described by the equation BP 


y[n] + 4y[n — 2] = 2x[n] . 
The initial conditions are yo[—1] = —1/(2./2) and yo[—2] = 1/(4./2). Verify the solution by computing the first three 
terms iteratively. 


Answers 


3 
yola] = (2)" cos (Zn - *) 


COMPUTER EXAMPLE C3.4 


Using the initial conditions y[—1] = 2 and y[—2] = 1, find and sketch the zero-input response for the system described by (E2 — 1.56E + 0.81)y[n] 
= (E + 3)x[n]. 


>> n = (-2:20)'; y=[1;2;zeros(length(n)-2,1)]; 
>> for k = 1:length(n) -2 

>> y(k+2) = 1.56*y(k+1) -0.81*y(k); 

>> end 


>> clf; stem(n,y,'k'); xlabel('n'); ylabel(y[n]'); 
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Figure C3.4 


[tla signal of the form n'y" also satisfies this requirement under certain conditions (repeated roots), discussed later. 


[t]The initial conditions y[-1] and y[—2] are the conditions given on the total response. But because the input does not start until n = 0, the zero- 
state response is zero for n < 0. Hence, at n = —1 and —2 the total response consists of only the zero-input component, so that y[—1] = yo[-1] 


and y[—2] = yo[—2]. 


3.7 THE UNIT IMPULSE RESPONSE h[n] 


Consider an nth-order system specified by the equation 


(E* +a, E"-' +--- + ay E +ay)ylal 


= (boE* +b EX +--+ + by iE + by)xin] (3.42a) 
or 
O[F]y[n] = P[E]x[n] (3.42b) 
The unit impulse response h[n] is the solution of this equation for the input 5[n] with all the initial conditions zero; that is, 
O[E\h[n] = P[E}é[n] (3.43) 
subject to initial conditions 
h{—1] = h[-—2] = --- = hA[—N] =0 (3.44) 


Equation (3.43) can be solved to determine h[n] iteratively or in a closed form. The following example demonstrates the iterative solution. 


EXAMPLE 3.11: (Iterative Determination of h[n]) _ 


Find hA[n], the unit impulse response of a system described by the equation 


y[n] — 0.6y[n — 1] — 0.16y[n — 2] = S5x[n] (3.45) 


To determine the unit impulse response, we let the input x[n] = 5[n] and the output y[n] = A[n] in Eq. (3.45) to obtain 
h[n] — 0.6h[n — 1] — 0.16h[n — 2] = 58[n] (3.46) 
subject to zero initial state; that is, h[—1] = h[-2] = 0. 


Setting n = 0 in this equation yields 


h[0] — 0.6(0) — 0.16(0) = 51) => A[0] =5 


Next, setting n = 1 in Eq. (3.46) and using h[0] = 5, we obtain 
h{1] — 0.6(5) — 0.16(0) = 5(0) = > Afi] =3 


Continuing this way, we can determine any number of terms of h[n]. Unfortunately, such a solution does not yield a closed-form expression for A[n]. 
Nevertheless, determining a few values of h[n] can be useful in determining the closed-form solution, as the following development shows. 


THE CLOSED-FORM SOLUTION OF h[n] 
Recall that h[n] is the system response to input 5[n], which is zero for n > 0. We know that when the input is zero, only the characteristic modes 
can be sustained by the system. Therefore, h[n] must be made up of characteristic modes for n > 0. At n = 0, it may have some nonzero value Ag, 


so that a general form of h[n] can be expressed aslt] 


h[{n] = Aod[n] + y-[n]u[n] (3.47) 


where y,[n] is a linear combination of the characteristic modes. We now substitute Eq. (3.47) in Eq. (3.43) to obtain Q[E] (Ag8[n] + y-[n]u[n] = 


P[E]8[n]). Because y,[n] is made up of characteristic modes. Q[F]y¢ [n]u[n] = 0, and we obtain Ag Q[E]8[n] = P[E]8[n], that is, 
Ao (8[n + N] + aidin + N — 1] +--- +ayS[n]) = bod[n + N]+--- + byd[n] 


Setting n = 0 in this equation and using the fact that 5[m] = 0 for all m # 0, and 8[0] = 1, we obtain 


bh y 
Acty=by => A= — (3.48) 
ayn 
Hencel#] 
by 
h[n] = a 4[n] + y.[n]u[n] (3.49) 
N 


The N unknown coefficients in y,[n] (on the right-hand side) can be determined from a knowledge of N values of h[n]. Fortunately, it is a 


straightforward task to determine values of h[n] iteratively, as demonstrated in Example 3.11. We compute N values A[0], A[1], A[2],..., ALN - 1] 
iteratively. Now, setting n = 0,1,2,..., N — 1 in Eq. (3.49), we can determine the N unknowns in y,[n]. This point will become clear in the following 
example. 


EXAMPLE 3.12 
Determine the unit impulse response h[n] for a system in Example 3.11 specified by the equation 


y[n] — 0.6y[n — 1] — 0.16y[n — 2] = 5x[n] 
This equation can be expressed in the advance operator form as 

y[n + 2] — 0.6y[n + 1] — 0.16y[n] = 5x[n + 2] (3.50) 
or 

(E? — 0.6 — 0.16)y[n] = SE*x{n] (3.51) 


The characteristic polynomial is 


y? —0.6y — 0.16 = (y + 0.2)(y — 0.8) 


The characteristic modes are (—0.2)" and (0.8)". Therefore 


Vela] = c1(—0.2)" + c2(0.8)" (3.52) 
Also, from Eq. (3.51), we have ay = —0.16 and by = 0. Therefore, according to Eq. (3.49) 
h{n] = [e:(—0.2)" + c2(0.8)"lu{n] (3.53) 


To determine c, and cz, we need to find two values of h[n] iteratively. This step is already taken in Example 3.11, where we determined that h[0] = 
5 and h[1] = 3. Now, setting n = 0 and 1 in Eq. (3.53) and using the fact that h[0] = 5 and h[1] = 3, we obtain 


5 =C, + C2 qQ\= 
=— 
3= —0.2¢, + 0.8¢2 C2 —4 


Therefore 


h[n] = [(—0.2)" + 4(0.8)" luin] (3.54) 


VOREVTEn Ene oe 


Use MATLAB to solve Example 3.12. 


There are several ways to find the impulse response using MATLAB. In this method, we first specify the input as a unit impulse function. Vectors a 
and b are created to specify the system. The filter command is then used to determine the impulse response. In fact, this method can be used 
to determine the zero-state response for any input. 


>> n = (0: 19); x = inline ('n==0'); 

>> a = [1 -0.6 -0.16]; b = [5 0 O]; 

>> h = filter (b,a,x(n)); 

>> clf; stem(n,h,'k'); xlabel ('n'); ylabel('h[n]"'); 


=) 
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n 
Figure C3.5 


Comment. Although it is relatively simple to determine the impulse response h[n] by using the procedure in this section, in Chapter 5 we shall 
discuss the much simpler method of the z—transform. 


EXERCISE E3.14 


Find h[n], the unit impulse response of the LTID systems specified by the following 9? 
equations: 


o 


- yl[n + 1] — yln] = x[n] 

b. y[n] — 5y[n — 1] + 6y[n — 2] = 8x[n — 1] — 19x[n — 2] 
c. y[n + 2] — 4y[n + 1] + 4y[n] = 2x[n + 2] — 2x[n + 1] 

d. y[n] = 2x[n] — 2x[n — 1] 


Answers 


fe) 


. A[n] = u[n — 1] 
bp. Ala] = —23{[n] + [$(2)" + £(3)"]ula] 
c. A[n] = (2 + n)2"u[n] 


d. h[n] = 28[n] — 28[n — 1] 


[tlWe assumed that the term yc[n] consists of characteristic modes for n > 0 only. To reflect this behavior, the characteristic terms should be 
expressed in the form y7ju[n — 1]. But because u[n — 1] = u[n] — 8[n], cjyju[n — 1]= cy" ju[n] = c8[n], and y,[n] can be expressed in terms of 


exponentials 8” u[n] (which start at n = 0), plus an impulse at n = 0. 


[tif ay = 0, then Ap cannot be determined by Eq. (3.48). In such a case, we show in Section 3.12 that h[n] is of the form Agd[n] + A,8[n — 1] + 
y-[n]u[n]. We have here N + 2 unknowns, which can be determined from N + 2 values [0], A[1],..., A[N + 1] found iteratively. 


3.8 SYSTEM RESPONSE TO EXTERNAL INPUT: THE ZERO-STATE RESPONSE 


The zero-state response y[n] is the system response to an input x[n] when the system is in the zero state. In this section we shall assume that 
systems are in the zero state unless mentioned otherwise, so that the zero-state response will be the total response of the system. Here we follow 
the procedure parallel to that used in the continuous-time case by expressing an arbitrary input x[n] as a sum of impulse components. A signal x[n] 
in Fig. 3.16a can be expressed as a sum of impulse components such as those depicted in Fig. 3.16b-3.16f. The component of x[n] at n = mis 
x[m]8[n — m], and x[n] is the sum of all these components summed from m = —co to co. Therefore 


x[n] = x[0]5[n] + x[1]8[n — 1) + x[2]5[n — 2] + -- 


+x[—1)d[a + 1] + x[—2]8[n + 2] +--- 


= > x[m|é[a — m] (3.55) 


fit 00 


x{n] 
(a) | | 
y es) 1234s 
xf —2]6[n + 2] 
(b) -2—__9__@_@___0-__© 
2 a 
x{—1]5[n + 1] 
(ce) > a a ed 
! a 
| x{0}8[n] 
(d) > oe fe 
el 
x{1]d[ — 1) 
fc = -—o— | —o—_—_e — 
! a 
x[2]6[" — 2] 
(ft) ->——_-—o- | o——> 
2 a 


Figure 3.16: Representation of an arbitrary signal x[n] in terms of impulse components. 


For a linear system, knowing the system response to impulse 8[n], the system response to any arbitrary input could be obtained by summing the 
system response to various impulse components. Let h[n] be the system response to impulse input 5[n]. We shall use the notation 
x[n] = yl[r] 


to indicate the input and the corresponding response of the system. Thus, if 
d[n] => Ain] 


then because of time invariance 
d[n — mm] ==> A[n — m] 


and because of linearity 
x[m]é[n — m] => x[m]h[n — m] 


and again because of linearity 
x wx 


yi x[m]é[n —m] = > x[mJh[n — m] 


m=—oO m=——oO© 


x{a] yin] 


The left-hand side is x[n] [see Eq. (3.55)], and the right-hand side is the system response y{n] to input x[n]. Therefore! T] 


wo 


y[a] = se x[mJh[a — m] (3.56) 


mo——OO 
The summation on the right-hand side is known as the convolution sum of x[n] and h[n], and is represented symbolically by x[n] * hA[n] 
~~) 


x[a] *A[n] = s; x[mJh[n — m] (3.57) 


Ma OO 


PROPERTIES OF THE CONVOLUTION SUM 

The structure of the convolution sum is similar to that of the convolution integral. Moreover, the properties of the convolution sum are similar to 
those of the convolution integral. We shall enumerate these properties here without proof. The proofs are similar to those for the convolution 
integral and may be derived by the reader. 


The Commutative Property. 


Xi fn] * x2[n] = x[n] * x [rn] (3.58) 


The Distributive Property. 

xi[n] * (o[n] + x3[n]) = x [n] * x2[n] + x, [n] * x3[n] (3.59) 
The Associative Property. 

xi [n] * (2[n] # x3[2]) = (i [n] * x2[n]) * x3[n] (3.60) 


The Shifting Property. If 
X1[n] * xo[n] = c[n] 


then 
x, [n — m] * x,[n — p] = c[n — m — p] (3.61) 


The Convolution with an Impulse. 


x[n] * 5[n] = x[n] (3.62) 


The Width Property. If x;[n] and x2[n] have finite widths of Wy and W, respectively, then the width of x4[n] * xg[n] is Wy + W2. The width of a 
signal is one less than the number of its elements (length). For instance, the signal in Fig. 3.17h has six elements (length of 6) but a width of only 
5. Alternately, the property may be stated in terms of lengths as follows: if x4[n] and x2[n] have finite lengths of L; and Lz elements, respectively, 
then the length of x4[n] * xg[n] is L; + Lp — 1 elements. 


CAUSALITY AND ZERO-STATE RESPONSE 

In deriving Eq. (3.56), we assumed the system to be linear and time invariant. There were no other restrictions on either the input signal or the 
system. In our applications, almost all the input signals are causal, and a majority of the systems are also causal. These restrictions further simplify 
the limits of the sum in Eq. (3.56). If the input x[n] is causal, x[m] = 0 for m < 0. Similarly, if the system is causal (i.e., if h[n] is causal), then h[x] = 
0 for negative x, so that h[n — m] = 0 when m > n. Therefore, if x[n] and A[n] are both causal, the product x[m]h[n — m] = 0 for m < 0 and for m > 
n, and it is nonzero only for the range 0 < m < n. Therefore, Eq. (3.56) in this case reduces to 


n 


y[n] = So xbnynin —m] (3.63) 


m=O 
We shall evaluate the convolution sum first by an analytical method and later with graphical aid. 
EXAMPLE 3.13 


Determine c[n] = x[n] * g[n] for 


x[a] = (0.8)"ul[n] and gla] = (0.3)"u[n] 


We have 
3 
c[n] = 2, x[mJ]g[n — m] 
m=——0o 
Note that 


x[m] = (0.8)"u[m] and gla — m] = (0.3)"""uln — m] 
Both x[n] and g[n] are causal. Therefore, [see Eq. (3.63)] 


c[n] = So xin Je[a — m] 


m=0 


= 55 (0.8)"ulm] (0.3)""ula — m) (3.64) 


m=) 


In this summation, m lies between 0 and n (0 < m < n). Therefore, if n = 0, then both m and n — m < 0, so that u[m] = u[n — m] = 1. If n<0,m 
is negative because m lies between 0 and n, and u[m] = 0. Therefore, Eq. (3.64) becomes 
n 


c[n] = 55 (0.8)" (0.3)""™ n=O 


m=0 
= 0 n<Q0 
and 
0.8\™ 
—_ 3 n odin 
c{n] = 0.3)" 5> (5) u(r] 


This is a geometric progression with common ratio (0.8/0.3). From Section B.7-4 we have 


(0.8)**! — (0.3)"*! 
(0.3)"(0.8 — 0.3) 


= 2{(0.8)"*? — (0.3)"*" Juin} (3.65) 


c[n] = (0.3)" u[n]} 


EXERCISE E3.15 
Show that (0.8)"u[n] * u[n] = 5[1 — (0.8)*"Ju[n]. 


CONVOLUTION SUM FROM A TABLE 
Just as in the continuous-time case, we have prepared a table (Table 3.1) from which convolution sums may be determined directly for a variety of 
signal pairs. For example, the convolution in Example 3.13 can be read directly from this table (pair 4) as 


0.8 aod 0.3 nel 
(0.8)"uln] # (0.3)"uln] = ee = 2[(0.8)"*' — (0.3)"*" Jul] 


Table 3.1: Convolution Sums 


No. xlal ale) aylel © xylan] = xpi) + aylel 
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We shall demonstrate the use of the convolution table in the following example. 


EXAMPLE 3.14 
Find the (zero-state) response y[n] of an LTID system described by the equation 


y[n + 2] — 0.6y[n + 1] — 0.16y[n] = Sx[n + 2] 


If the input x[n] = 4 u[n]. 


The input can be expressed as x[n] = 47" u[n] = (1/4)"u[n] = (0.25)"u[n]. The unit impulse response of this system was obtained in Example 3.12. 


h[n] = [(—0.2)" + 4(0.8)"]u[n] 
Therefore 
y[n] = x[n] * A[n] 
= (0.25)"uf[n] = [(—0.2)"u[n] + 4(0.8)"ufn]] 


= (0.25)"uln] * (—0.2)" uln] + (0.25)" ula] * 4(0.8)" ula} 


We use pair 4 (Table 3.1) to find the foregoing convolution sums. 


(0.25)"*! — (-0.2)"*! (0.25)"*! — (0.8)"*! 
¥ i oneeeEnnEnPGnEEEEEEEEEEEP OEE reese 
yin} | 0.25-(-02)** oas-o8 | “lal 


= (2.22[(0.25)"*! — (—0.2)"*"] — 7.27[(0.25)"*! — (0.8)"*! ul] 
= [—5.05(0.25)**! — 2.22(—0.2)"*! + 7.27(0.8)"*" Juin] 


Recognizing that 
1 
y= y(y)" 


We can express y[n] as 
yln] = [—1.26(0.25)”" + 0.444(—0.2)" + 5.81(0.8)" Jula} 
= [—1.26(4)~" + 0.444(—0.2)" + 5.81(0.8)" |u[n] 


EXERCISE E3.16 
Show that 


(0.8)"*! u[n] * ufn] = 4[1 — 0.8(0.8)" Juin] 


EXERCISE E3.17 


Show that 
n3-"u[n] « (0.2)"u{n] = 43[(0.2)" — (1 — 3n)3~"] ulin) 


EXERCISE £3.18 
Show that 


e"u[n] *2-"u[n] = — le - <2" un] 


COMPUTER EXAMPLE C3.6 
Find and sketch the zero-state response for the system described by (E? + 6E + 9)y[n] = (2E2 + 6E)x[n] for the input x[n] = 47" u[n]. 


Although the input is bounded and quickly decays to zero, the system itself is unstable and an unbounded output results. 


>> n = (0:11); x = inline('(4.%(-n)).* (n>=0)'); 

>> a= [1 6 9]; b= [2 6 O]; 

>> y = filter (b,a,x(n)); 

>> clf; stem(n,y,'k'); xlabel ('n'); ylabel('y[n]"'); 
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Figure C3.6 


RESPONSE TO COMPLEX INPUTS 
As in the case of real continuous-time systems, we can show that for an LTID system with real h[n], if the input and the output are expressed in 
terms of their real and imaginary parts, then the real part of the input generates the real part of the response and the imaginary part of the input 
generates the imaginary part. Thus, if 


x[n] = x,[n] + jx, [n] and y[n] = y-[n] + jy [n] (3.66a) 
using the right-directed arrow to indicate the input-output pair, we can show that 
x,[n] => y,[n] and x[n] = y,[n] (3.66b) 
The proof is similar to that used to derive Eq. (2.40) for LTIC systems. 
MULTIPLE INPUTS 


Multiple inputs to LTI systems can be treated by applying the superposition principle. Each input is considered separately, with all other inputs 
assumed to be zero. The sum of all these individual system responses constitutes the total system output when all the inputs are applied 
simultaneously. 


3.8-1 Graphical Procedure for the Convolution Sum 


The steps in evaluating the convolution sum are parallel to those followed in evaluating the convolution integral. The convolution sum of causal 
signals x[n] and g[n] is given by 
n 


c[n] = 5 x[m]gin —m|] 


m=) 


We first plot x[m] and g[n — m] as functions of m (not n), because the summation is over m. Functions x[m] and g[m] are the same as x[n] and 
g[n], plotted respectively as functions of m (see Fig. 3.17). The convolution operation can be performed as follows: 


1. Invert g[m] about the vertical axis (m = 0) to obtain g[—m] (Fig. 3.17d). Figure 3.17e shows both x[m] and g[— mm]. 


2. Shift g[—m] by rn units to obtain g[n — m]. For n > 0, the shift is to the right (delay); for n < 0, the shift is to the left (advance). Figure 
3.17f shows g[n — m] for n > 0; for n < 0, see Fig. 3.17g. 


3. Next we multiply x[m] and g[n — m] and add all the products to obtain c[n]. The procedure is repeated for each value of n over the 
range —co to ~. 


We shall demonstrate by an example the graphical procedure for finding the convolution sum. Although both the functions in this example are 
causal, this procedure is applicable to general case. 


EXAMPLE 3.15 


Find 
c[n] = x[n] * g[n] 
where x[n] and g[n] are depicted in Fig. 3.17a and 3.17b, respectively. 
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Figure 3.17: Graphical understanding of convolution of x[n] and g[n]. 


We are given 


x[a] = (0.8)" and g[n] = (0.3)" 


Therefore 


x[m] = (0.8)" and 2[n — m] = (0.3)""" 
Figure 3.17f shows the general situation for n => 0. The two functions x[m] and g[n — m] overlap over the interval 0 < m < n. Therefore 
n 


c[n] = >> ximlgin —m] 


ata) 


= )°(0.8)"(0.3)"™" 


m=) 


= (0.3)" >> (3S) 


= 2{(0.8)"*' — (0.3)"*"]} n>O0 (see Section B.7-4) 


For n < 0, there is no overlap between x[m] and g[n — m], as shown in Fig. 3.17g so that 


c[n] = 0 n<0O 


and 
c[n] = 2[(0.8)"*! — (0.3)"*"Jufn] 


which agrees with the earlier result in Eq. (3.65). 


EXERCISE E3.19 


Find (0.8)"u[n] * u[n] graphically and sketch the result. 2? 


Answers 


5(1 — (0.8)"*" ula] 


AN ALTERNATIVE FORM OF GRAPHICAL PROCEDURE: THE SLIDING-TAPE METHOD 

This algorithm is convenient when the sequences x[n] and g[n] are short or when they are available only in graphical form. The algorithm is 
basically the same as the graphical procedure in Fig. 3.17. The only difference is that instead of presenting the data as graphical plots, we display it 
as a sequence of numbers on tapes. Otherwise the procedure is the same, as will become clear in the following example. 


EXAMPLE 3.16 
Use the sliding-tape method to convolve the two sequences x[n] and g[n] depicted in Fig. 3.18a and 3.18b, respectively. 
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Figure 3.18: Sliding-tape algorithm for discrete-time convolution. 


In this procedure we write the sequences x[n] and g[n] in the slots of two tapes: x tape and g tape (Fig. 3.18c). Now leave the x tape stationary (to 
correspond to x[m]). The g[—m] tape is obtained by inverting the g[m] tape about the origin (m = 0) so that the slots corresponding to x[0] and g[0] 
remain aligned (Fig. 3.18d). We now shift the inverted tape by n slots, multiply values on two tapes in adjacent slots, and add all the products to 
find c[n]. Figure 3.18d-3.18i shows the cases for n = 0-5. Figure 3.18j-3.18k, and 3.181 shows the cases for n = —1, —2, and —3, respectively. 


For the case of n = 0, for example (Fig. 3.18d) 
c[0] = (—-2 x 1) +(-1 xD) +0x)=-3 


For n= 1 (Fig. 3.18e) — ; ; 
c[1] = (—-2 x 1) + (-L x D+ (Ox D4+(1 x1) =-2 


Similarly, 
2] = (-2 x Ib + (-1 kx D+ Ox D+(lxD4+2xD=0 


c{3] = (-2 x 1) + (=1 x 1) + (Ox 1+ (1 x 1 +(2%1)+3 x1) =3 

c[4] = (-2 x I) + (-1 KD + Ox D+ x ID 4+2x1I4+3«K1I4+4x I) =7 
AS} =(-2 x D+ (-1 x D+ Oxl + xID+2xD+3xD+(4x1I=7 
Figure 3.18i shows that c[n] = 7 for n = 4 


Similarly, we compute c[n] for negative n by sliding the tape backward, one slot at a time, as shown in the plots corresponding to n = —1, —2, and 
—3, respectively (Fig. 3.18j, 3.18k, and 3.181). 


c{[—1] = (-2 x 1)+ (-1 x I) = -3 
c[—2] = (-2 x 1) = —2 


c[—3] = 0 
Figure 3.181 shows that c[n] = 0 for n < 3. Figure 3.18m shows the plot of c[n]. 


EXERCISE E3.20 


Use the graphical procedure of Example 3.16 (sliding-tape technique) to show that x[n]*g[n] = c[n] in Fig. 3.19. Verify the width property of 
convolution. 
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Figure 3.19 


COMPUTER EXAMPLE C3.7 


For the signals x[n] and g[n] depicted in Fig. 3.19, use MATLAB to compute and plot c[n] = x[n] * g[n]. 


>> x = [0 123 21]; [1 11111]; 

>> n= (0:1:length (x)+length(g) -2); 

>> c=conv(x,g); 

>> clf; stem(n, c, 'k'); xlabel('n'); ylabel('c[n]"); 


c[n] 


Figure C3.7 


3.8-2 Interconnected Systems 


As with continuous-time case, we can determine the impulse response of systems connected in parallel (Fig. 3.20a) and cascade (Fig. 3.20b, 
3.20c). We can use arguments identical to those used for the continuous-time systems in Section 2.4-3 to show that if two LTID systems S; and 
S2 with impulse response h4[n] and hg[n], respectively, are connected in parallel, the composite parallel system impulse response is hy4[n] + hog[n]. 
Similarly, if these systems are connected in cascade (in any order), the impulse response of the composite system is h4[n] *hg[n]. Moreover, 
because h,[n] *hg[n] = h2[n] *h4[n], linear systems commute. Their orders can be interchanged without affecting the composite system behavior. 


hdr) = Ayla) + Agfa) 


(a) 


Sy 
an] ps] vie] = 2 


fe) 
Figure 3.20: Interconnected systems. 


INVERSE SYSTEMS 
If the two systems in cascade are inverse of each other, with impulse responses h[n] and hj[n], respectively, then the impulse response of the 
cascade of these systems is h[n] * hj[n]. But, the cascade of a system with its inverse is an identity system, whose output is the same as the input. 


Hence, the unit impulse response of an identity system is d[n]. Consequently 


h{n] * hj[n] = 3[n] (3.67) 
As an example, we show that an accumulator system and a backward difference system are inverse of each other. An accumulator system is 
specified by!T] 


yin} = S> xfk] (3.68a) 


k=-00 


The backward difference system is specified by 
y[n] = x[n] — x[n — 1] (3.68b) 


From Eq. (3.68a), we find hgc-[n], the impulse response of the accumulator, as 


helt] = S> d{k] = ula] (3.69a) 


k=-—c0o 


Similarly, from Eq. (3.68b), Mpg¢[n], the impulse response of the backward difference system is given by 


hyaln] = 5[n] — d[n — 1] (3.69b) 


We can verify that 


Neco * Apag = uln] * [[n] — 8[n — 1]} = ufn] — u[n — 1] = 3f[n] 


Roughly speaking, in discrete-time systems, an accumulator is analogous to an integrator in continuous-time systems, and a backward difference 
system is analogous to a differentiator. We have already encountered examples of these systems in Examples 3.6 and 3.7 (digital differentiator and 
integrator). 


SYSTEM RESPONSE TO =",=_ . X[K] 

Figure 3.20d shows a cascade of two LTID systems: a system S with impulse response h[n], followed by an accumulator. Figure 3.20e shows a 
cascade of the same two systems in reverse order: an accumulator followed by S. In Fig. 3.20d, if the input x[n] to S results in the output y[n], then 
the output of the system 3.20d is the = y[k]. In Fig. 3.20e, the output of the accumulator is the sum > x[k]. Because the output of the system in 
Fig. 3.20e is identical to that of system Fig. 3.20d, it follows that 


if x[n] => yla] 


then >> xiki=—> >> yikl (3.70a) 


— a 
If we let x[n] = 8[n] and y[n] = A[n] in Eq. (3.70a), we find that g[n], the unit step response of an LTID system with impulse response h[n], is given 
by 
n 
gink= 5— AfkI (3.70b) 
k=—00 


The reader can readily prove the inverse relationship 


h[n] = g[n] — g[n — 1] (3.70c) 


3.8-3 A Very Special Function for LTID Systems: The Everlasting Exponential z” 


In Section 2.4-4, we showed that there exists one signal for which the response of an LTIC system is the same as the input within a multiplicative 
constant. The response of an LTIC system to an everlasting exponential input et is H(s)e*, where H(s) is the system transfer function. We now 
show that for an LTID system, the same role is played by an everlasting exponential z”. The system response y{[n] in this case is given by 
y[n] = An] « 2” 
oe 
= ‘2 Atmjz*~” 
m=—O 
20 


— i > h{m|z°" 


m=— Oo 


For causal A[n], the limits on the sum on the right-hand side would range from 0 to o. In any case, this sum is a function of z. Assuming that this 
sum converges, let us denote it by H[z]. Thus, 


y[n] = Alz]z" (3.71a) 
where 
H{[z] = y. A[m]z-™ (3.71b) 


Equation (3.71a) is valid only for values of z for which the sum on the right-hand side of Eq. (3.71b) exists (converges). Note that H[z] is a 
constant for a given z. Thus, the input and the output are the same (within a multiplicative constant) for the everlasting exponential input z”. 


H[z], which is called the transfer function of the system, is a function of the complex variable z. An alternate definition of the transfer function H[z] 
of an LTID system from Eq. (3.71a) as 


t signal 
nn. (3.72) 


input signal inpul=everlasting exponential 2* 


The transfer function is defined for, and is meaningful to, LTID systems only. It does not exist for nonlinear or time-varying systems in general. 


We repeat again that in this discussion we are talking of the everlasting exponential, which starts at n = — oo, not the causal exponential z”u[n], 
which starts at n = 0. 


For a system specified by Eq. (3.24), the transfer function is given by 


P[z] 
A[z] = — 3.73 
[2] Q[z] a 


This follows readily by considering an everlasting input x[n] = z”. According to Eq. (3.72), the output is y[n] = H[z]z”. Substitution of this x[n] and 
y[n] in Eq. (3.24b) yields 
A(z] {O[E]z"} = P[E]2" 


Moreover 
EFz" a ott k a 
Hence 


PLE]2" = Pizlz” and QTE] 2" = Q[z]2” 


Consequently, 


P[z] 

Q[z] 
EXERCISE E324 
Show that the transfer function of the digital differentiator in Example 3.6 (big shaded block in Fig. 3.14b) is given by H[z] = (z — 1)/Tz, and the 
transfer function of an unit delay, specified by y[n] = x[n — 1], is given by 1/z. 


A[z] = 


3.8-4 Total Response 


The total response of an LTID system can be expressed as a sum of the zero-input and zero-state components: 
N 


total response = be cy; + xin) *hi[n} 
—— 
f=1 zero-state component 


zero-inpul component 


In this expression, the zero-input component should be appropriately modified for the case of repeated roots. We have developed procedures to 
determine these two components. From the system equation, we find the characteristic roots and characteristic modes. The zero-input response is 
a linear combination of the characteristic modes. From the system equation, we also determine h[n], the impulse response, as discussed in Section 
3.7. Knowing h[n] and the input x[n], we find the zero-state response as the convolution of x[n] and h[n]. The arbitrary constants cj, C9,..., Cp in 


the zero-input response are determined from the n initial conditions. For the system described by the equation 


y[n + 2] — 0.6y[n + 1] — 0.16y[n] = S5x[n + 2] 


with initial conditions y[—1] = 0, y[—2] = 25/4 and input x[n] = (4)""u[n], we have determined the two components of the response in Examples 
3.10a and 3.14, respectively. From the results in these examples, the total response for n = 0 is 


total response = 0.2(—0.2)" + 0.8(0.8)" —1.26(4)"" + 0.444(—0.2)" + 5.81(0.8)" (3.74) 
See 


Reror ing COMPOREN rero-staee Componcat 


NATURAL AND FORCED RESPONSE 


The characteristic modes of this system are (—0.2)" and (0.8)". The zero-input component is made up of characteristic modes exclusively, as 
expected, but the characteristic modes also appear in the zero-state response. When all the characteristic mode terms in the total response are 
lumped together, the resulting component is the natural response. The remaining part of the total response that is made up of noncharacteristic 
modes is the forced response. For the present case, Eq. (3.74) yields 


total response = 0.644(—0.2)" + 6.61(0.8)" — 1.26(4)"" n=O (3.75) 
ee 
natural response foreed response 


[Tin deriving this result, we have assumed a time-invariant system. The system response to input 5[n — m] for a time-varying system cannot be 
expressed as h[n — ml], but instead has the form h[n, m]. Using this form, Eq. (3.56) is modified as follows: 


oo 


y[a]= s x[m]h[n, m] 


mi=—oO 


[tlEquations (3.68a) and (3.68b) are identical to Eqs. (3.14a) and (3.12), respectively, with T = 1. 


3.9 CLASSICAL SOLUTION OF LINEAR DIFFERENCE EQUATIONS 


As in the case of LTIC systems, we can use the classical method, in which the response is obtained as a sum of natural and forced components of 
the response, to analyze LTID systems. 


FINDING NATURAL AND FORCED RESPONSE 
As explained earlier, the natural response of a system consists of all the characteristic mode terms in the response. The remaining 
noncharacteristic mode terms form the forced response. If y,[n] and Yaln] denote the natural and the forced response respectively, then the total 


response is given by 


total response = y,[n] + ys] (3.76) 
—— —— 
modes nonmodes 


Because the total response y,[n] + Y@[n] is a solution of the system equation (3.24b), we have 


Q[E\(y-[n] + yeln}) = P[E]x[n] (3.77) 
But since y,[n] is made up of characteristic modes, 
O[E}y-[n] = 0 (3.78) 


Substitution of this equation in Eq. (3.77) yields 
O[Ely.[n] = P[Elx[n] (3.79) 


The natural response is a linear combination of characteristic modes. The arbitrary constants (multipliers) are determined from suitable auxiliary 
conditions usually given as y[0], y[1],..., yin — 1]. The reasons for using auxiliary instead of initial conditions are explained later. If we are given 
initial conditions y[-1], y[-2],..., yi—N], we can readily use iterative procedure to derive the auxiliary conditions y[O], y[1],..., y[N — 1]. We now turn 
our attention to the forced response. 


Table 3.2: Forced Response 
= Open table as spreadsheet 


No. Input x[n] Forced response y[n] 
1 rr? 2; (i=1, 2,..., N) cf? 


[2 [ere yi enr” 


3 cos (Bn + 6) c cos (Bn + >) 


Note: By definition, yp[n] cannot have any characteristic mode terms. Should any term shown in the right-hand column for the forced response 
be a characteristic mode of the system, the correct form of the forced response must be modified to ni yo[n], where jis the smallest integer 
that will prevent n! y[n] from having a characteristic mode term. For example, when the input is r’, the forced response in the right-hand 
column is of the form cr’. But if r’ happens to be a natural mode of the system, the correct form of the forced response is cnr"(see pair 2). 


The forced response yd[n] satisfies Eq. (3.79) and, by definition, contains only nonmode terms. To determine the forced response, we shall use 
the method of undetermined coefficients, the same method used for the continuous-time system. However, rather than retracing all the steps of the 
continuous-time system, we shall present a table (Table 3.2) listing the inputs and the corresponding forms of forced function with undetermined 
coefficients. These coefficients can be determined by substituting y[n] in Eq. (3.79) and equating the coefficients of similar terms. 


EXAMPLE 3.17 


Solve 


(E? — SE +6)yln] = (E —5)x{[n] (3.80) 
if the input x[n] = (3n + 5)u[n] and the auxiliary conditions are y[0] = 4, y[1] = 13. 
The characteristic equation is 
y° —Sy +6=(y —2)(y —3) =0 


Therefore, the natural response is 


yeln] = By(2)" + B23)" 


To find the form of forced response yo[n], we use Table 3.2, pair 4, with r= 1, m= 1. This yields 
yg[a] = cin + Co 


Therefore 
yoln + 1] =cC(n+ 1) +p = Cn +C; + Co 
yoln + 2] = ci(n + 2) + co = crn +2€) + Co 


Also 
x[n] = 3n +5 


and 


x[n + 1] =3(n +1) +5=3n+8 


Substitution of these results in Eq. (3.79) yields 
Cin + 2c, + Co — Sein + Cr + Co) + 6(CiN + Co) = 3n + 8 — 5(3n + 5) 


Sein — 3¢, + 2¢o = —12n — 17 

Comparison of similar terms on the two sides yields 
2c; =-—12 c= -6 

8e+-2q=-17[ = a 

Therefore 

yela] = —6n — = 


The total response is 


y[n] = y-[n] + yg[a] 
= B,(2)" + B,(3)" —6n — = n=O 


To determine arbitrary constants B; and Bz we set n = 0 and 1 and substitute the auxiliary conditions y[0] = 4, y[1] = 13 to obtain 


4=B,+B,-% B, = 28 
a 
13 = 2B, + 3B,—-2 B,==2 


Therefore 
yeln] = 28(2)" — 83)" (3.81) 
and 
yln] = 28(2)" — 3(3)" —6n — 3 (3.82) 
— eet Nee 
Yeln} yeln) 


COMPUTER EXAMPLE C3.8 


Use MATLAB to solve Example 3.17. 


>> n = (-0:10)'; y=[4;13;zeros(length(n)-2,1); x = [3*n+5).* (n>=0); 
>> for k = 1:length(n)-2 

>> y(k+2) = S*y(k+1) - 6*y(k) + x(kt+1) - 5*x(k); 

>> end; 


>> clf; stem(n,y,'k'); xlabel('n'); ylabel('y[n]'); 
>> disp(' n y'); disp([num2str([n,y])]); 

y 
4 
Ls 
24 
13 
-120 
-731 
-3000 
-10691 
-35544 
=(13675: 
0 -355224 
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Figure C3.8 


EXAMPLE 3.18 
Find the sum y[n] if 


yinj=SoK? (3.83) 


k=0 
Such problems can be solved by finding an appropriate difference equation that has y[n] as the response. From Eq. (3.83), we observe that y[n + 
1] = y[n] + (n + 1). Hence 

y[n + 1] — y[n] = (n +1)? (3.84) 


This is the equation we seek. For this first-order difference equation, we need one auxiliary condition, the value of y[n] at n = 0. From Eq. (3.83), it 
follows that y[0] = 0. Thus, we seek the solution of Eq. (3.83) subject to an auxiliary condition y[0] = 0. 


The characteristic equation of Eq. (3.83) is y — 1 = 0, the characteristic root is y = 1, and the characteristic mode is c(1)" = cu[n], where c is an 
arbitrary constant. Clearly, the natural response is cu[n]. 


The input, x[n] = (n + 1)? =n? + 2n +1, is of the form in pair 4 (Table 3.2) with r= 1 and m= 2. Hence, the desired forced response is 


yoln| = Bon? + Bin + Bo 


Note, however, the term Bo in yd[n] is of the form of characteristic mode. Hence, the correct form is yp[n] = B3n? + Bn? + Bon. Therefore 
Eygln] = yeln + 1] = Bon + 1° + Bin + 1)? + Poin + VD 


From Eq. (3.79), we obtain 
(E —1)ygln] =n? +2n +1 


or 
[Brin + 1° + Bi(n + 1)? + Bon + 1] — [B.n? + Bin? + Bon] = 2? +2n +1 


Equating the coefficients of similar powers, we obtain 
eae we it et: | 
Bo — By = By as 
Hence 
In] 4 2m +3nt +n 4 At 1)(2n + 1) 
yin) = ¢ + = 0 4 
; 6 6 
Setting n = 0 in this equation and using the auxiliary condition y[0] = 0, we find c = 0 and 
, , 
2 +3n2-+n n(n +1)(2n+1) 
6 6 
COMMENTS ON AUXILIARY CONDITIONS 
This (classical) method requires auxiliary conditions y[0], y[1],..., y[N - 1]. This is because at n = -1, -2,..., —N, only the zero-input component 
exists, and these initial conditions can be applied to the zero-input component only. In the classical method, the zero-input and zero-state 
components cannot be separated. Consequently, the initial conditions must be applied to the total response, which begins at n = 0. Hence, we 
need the auxiliary conditions y[0], y[1],..., y[N - 1]. If we are given the initial conditions y[-1], y[-2],..., y[-N], we can use iterative procedure to derive 
the auxiliary conditions y[0], y[1],..., yin — 1]. 


yin] = 


AN EXPONENTIAL INPUT 


As in the case of continuous-time systems, we can show that for a system specified by the equation 
O[F y(n] = P[E]x[n] (3.85) 


the forced response for the exponential input x[n] = r” is given by 


yeln|=HIrlr" sr # y (accharacteristic mode) (3.86) 
where 
Pir] 
ay) = (3.87) 
QIr] 
The proof follows from the fact that if the input x[n] = r’, then from Table 3.2 (pair 4), yb[n] = cr”. Therefore 
E'x{aj=xint+ij=r arr" and —PLE]x[a] = P[r}r" 


E* y(n) = yo[n + k] = cr"** = cr*r" and O[E}y[n] = cO[r}r" 


so that Eq. (3.85) reduces to 
cQ[r]r” = P[rjr" 


which yields c = P[r]/Q[r] = H[r]. 
This result is valid only if ris not a characteristic root of the system. If ris a characteristic root, then the forced response is cnr” where c is 


determined by substituting yp[n] in Eq. (3.79) and equating coefficients of similar terms on the two sides. Observe that the exponential r” includes 
a wide variety of signals such as a constant C, a sinusoid cos (Bn + 8), and an exponentially growing or decaying sinusoid |y|" cos (Bn + 8). 


A Constant Input x[n] = C. This is a special case of exponential Cr” with r = 1. Therefore, from Eq. (3.86), we have 


~ cP) _ 
Yeln] = Conl = CH{I] (3.88) 


A Sinusoidal Input. The input e/@” is an exponential r” with r= e/@. Hence 


in 
yoln] = Hleie™ = Fle] 


Similarly, for the input e 
yeln] = H[e!* Je“ 


Consequently, if the input x[n] = cos Qn = 1/2(e/2" + eI"), then 
yoln] = + {Hei ]}e/™" + Hle~s@]e~J"} 

Since the two terms on the right-hand side are conjugates, 

ygln] = Re{ H[e/@Jei™"} 
If 

Hle’®] = |Hfe*}\e/ 4° 


then 


@ 


vol] = Re{|H[e!*}je/™4ate"d } 
= |H[e’* || cos(Qn + LHe’ }) (3.89a) 
Using a similar argument, we can show that for the input 
x[n] = cos (Qn + 0) 
yeln] = |A[e’*}| cos(Qn + 0 + LHfe’*}) (3.89b) 
EXAMPLE 3.19 


For a system specified by the equation 
(E? —3E +2)y[n] = (E +2)x{n] 
find the forced response for the input x[n] = (3)” u[n]. 


In this PL 1 2 
T r+ 
A= on Poor ee 


and the forced response to input (3)” u[n] is H[3](3)" u[n]; that is, 


[a] = —— Gala] = yen] =O 
Yel = a3) 42 0) =a een 2 


EXAMPLE 3.20 


For an LTID system described by the equation 
(E? — E +0.16)y[n] = (£ + 0.32)x[n] 
determine the forced response yo[n] if the input is 
= cos [2 = 

x[n] = cos (2n + 3 ) u[n] 
Here 

P 0.32 
H(r] = Pird _ ee 

Q[Ir] r—r+0.16 


For the input cos (2n + (11/3))u[n], the forced response is 


ygla] = | H[e!?]| cos (2n + : + :H{e’*1) ufn] 


where 

Hie”) = oF +032 (—0.416 + j0.909) + 0.32 
~ (e?)?—e/? +016  (—0.654 — 0.757) — (—0.416 + j0.909) + 0.16 
= 0.5482/°** 

Therefore 

|Hfe*]|=0.548 and Hf[e/*] = 3.294 

so that 


yyg[a] = 0.548 cos (2n + af + 3.294) u[n] 
= 0.548 cos (20 + 4.34)ul[n] 


ASSESSMENT OF THE CLASSICAL METHOD 
The remarks in Chapter 2 concerning the classical method for solving differential equations also apply to difference equations. 


3.10 SYSTEM STABILITY: THE EXTERNAL (BIBO) STABILITY CRITERION 


Concepts and criteria for the BIBO (external) stability and the internal (asymptotic) stability for discrete-time systems are identical to those 
corresponding to continuous-time systems. The comments in Section 2.6 for LTIC systems concerning the distinction between the external and the 
internal stability are also valid for LTID systems. 


Recall that 
y[n] = A[n] « x[n] 


oe 


= x A{m|x|a — m] 


and 
Fava) 
|y[r]| = cs A{m]x[n — m] 
m>——-cO 


< 5 |hlm)| |xfn — m)| 


If x[n] is bounded, then |x[n — m]| < K; < ~, and 
~ 


yin]| < Ki S> |All 


m=—oo 


Clearly the output is bounded if the summation on the right-hand side is bounded; that is, if 


oo 
Y= lilal| < Kz < c (3.90) 


a=—oO 
This is a sufficient condition for BIBO stability. We can show that this is also a necessary condition (see Prob. 3.10-1). Therefore, for an LTID 
system, if its impulse response h[n] is absolutely summable, the system is (BIBO) stable. Otherwise it is unstable. 


All the comments about the nature of the external and the internal stability in Chapter 2 apply to discrete-time case. We shall not elaborate them 
further. 


3.10-1 Internal (Asymptotic) Stability 


For LTID systems, as in the case of LTIC systems, the internal stability, called the asymptotical stability or the stability in the sense of Lyapunov 
(also the zero-input stability) is defined in terms of the zero-input response of a system. 
For an LTID system specified by a difference equation of the form (3.17) [or (3.24)], the zero-input response consists of the characteristic modes of 
the system. The mode corresponding to a characteristic root y is y". To be more general, let y be complex so that 
y=lvle* and = y"=ly\"e/* 
Since the magnitude of e”8” is always unity regardless of the value of n, the magnitude of y” is |y|". Therefore 
ly] <1, y"—0 asm —> Oo 

if |y|>1, y" > CO asi > & 

andif |y|=1, lv? =1 for alla 


Figure 3.21 shows the characteristic modes corresponding to characteristic roots at various locations in the complex plane 
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Figure 3.21: Characteristic roots location and the corresponding characteristic modes. 


These results can be grasped more effectively in terms of the location of characteristic roots in the complex plane. Figure 3.22 shows a circle of unit 
radius, centered at the origin in a complex plane. Our discussion shows that if all characteristic roots of the system lie inside the unit circle, |yi| < 1 
for all ij and the system is asymptotically stable. On the other hand, even if one characteristic root lies outside the unit circle, the system is unstable. 
If none of the characteristic roots lie outside the unit circle, but some simple (unrepeated) roots lie on the circle itself, the system is marginally 
stable. If two or more characteristic roots coincide on the unit circle (repeated roots), the system is unstable. The reason is that for repeated roots, 


the zero-input response is of the form n’—1y", and if |y| = 1, then |n’—1y"| = n'—1 — 0 asn— ow IT] 


Figure 3.22: Characteristic root locations and system stability. 
Note, however, that repeated roots inside the unit circle do not cause instability. To summarize: 


1. An LTID system is asymptotically stable if and only if all the characteristic roots are inside the unit circle. The roots may be simple or 
repeated. 


2. An LTID system is unstable if and only if either one or both of the following conditions exist: (i) at least one root is outside the unit 
circle; (ii) there are repeated roots on the unit circle. 


3. An LTID system is marginally stable if and only if there are no roots outside the unit circle and there are some unrepeated roots on the 
unit circle. 


3.10-2 Relationship Between BIBO and Asymptotic Stability 


For LTID systems, the relation between the two types of stability is similar to those in LTIC systems. For a system specified by Eq. (3.17), we can 
readily show that if a characteristic root y, is inside the unit circle, the corresponding mode y”, is absolutely summable. In contrast, if y, lies 


outside the unit circle, or on the unit circle, y" is not absolutely summable.!t] 


This means that an asymptotically stable system is BIBO stable. Moreover, a marginally stable or asymptotically unstable system is BIBO unstable. 
The converse is not necessarily true. The stability picture portrayed by the external description is of questionable value. BIBO (external) stability 
cannot ensure internal (asymptotic) stability, as the following example shows. 


EXAMPLE 3.21 

An LTID systems consists of two subsystems S, and Sp» in cascade (Fig. 3.23). The impulse response of these systems are h4[n] and ho[n], 
respectively, given by 

hy[n] = 45[n] — 3(0.5)"uln] = and sp fn] = 2" un] 


x[n] } ylal 
a AY 


Figure 3.23: BIBO and asymptotic stability. 
The composite system impulse response h[n] is given by 
hin} = hylan] + hola] = hg[n) + Ay [a] = 2" alr] * 44] 2] — 30.5)" uln)) 
P gett — (0,5)**] 
= 4(2)"u[n] —3 7-05 ufn]| 


= (0.5)"uln] 


If the composite cascade system were to be enclosed in a black box with only the input and the output terminals accessible, any measurement 


from these external terminals would show that the impulse response of the system is (0.5)” u[n], without any hint of the unstable system sheltered 
inside the composite system. 


The composite system is BIBO stable because its impulse response (0.5)"u[n] is absolutely summable. However, the system S> is asymptotically 


unstable because its characteristic root, 2, lies outside the unit circle. This system will eventually burn out (or saturate) because of the unbounded 
characteristic response generated by intended or unintended initial conditions, no matter how small. 


The system is asymptotically unstable, though BIBO stable. This example shows that BIBO stability does not necessarily ensure asymptotic stability 
when a system is either uncontrollable, or unobservable, or both. The internal and the external descriptions of a system are equivalent only when 
the system is controllable and observable. In such a case, BIBO stability means the system is asymptotically stable, and vice versa. 


Fortunately, uncontrollable or unobservable systems are not common in practice. Henceforth, in determining system stability, we shall assume that 
unless otherwise mentioned, the internal and the external descriptions of the system are equivalent, implying that the system is controllable and 
observable. 


EXAMPLE 3.22 
Determine the internal and external stability of systems specified by the following equations. In each case plot the characteristic roots in the 
complex plane. 


a. y[n + 2] + 2.5y[n + 1] + y[n] = x[n + 1] — 2x{[n] 
b. y[n] — y[n — 1] + 0.21y[n — 2] = 2x[n — 1] + 3x[n — 2] 
o. Yin +3) + 2yln +2) + 4yln + 1) + fyla) = xin + 1 


d. (E2 — E+ 1)y[n] = (3E + 1)x[n] 
a. The characteristic polynomial is 
y +2.5y +1=(y +0.5)(y +2) 


The characteristic roots are —0.5 and —2. Because |—2| > 1 (—2 lies outside the unit circle), the system is BIBO unstable and also 
asymptotically unstable (Fig. 3.24a). 


iC) (a) 
Figure 3.24: Location of characteristic roots for the systems. 


b. The characteristic polynomial is 
y?>—y +0.21 = (y —0.3)(y —0.7) 


The characteristic roots are 0.3 and 0.7, both of which lie inside the unit circle. The system is BIBO stable and asymptotically stable 
(Fig. 3.24b). 


c. The characteristic polynomial is 
vy +2y? + by +4 =(7 + Dy? +y +4) =O + Uy +05 = j0.5y +05 + j0.5) 


The characteristic roots are —1, —0.5 + j0.5 (Fig. 3.24c). One of the characteristic roots is on the unit circle and the remaining two 
roots are inside the unit circle. The system is BIBO unstable but marginally stable. 


d. The characteristic polynomial is 
2 2 
(?-y +1) = (y-4$-s4) (y-$4/4) 


The characteristic roots are (1/2) + j(./3/2) = 1e*/("/S) repeated twice, and they lie on the unit circle (Fig. 3.24d). The system is BIBO 
unstable and asymptotically unstable. 


EXERCISE E3.22 


Find and sketch the location in the complex plane of the characteristic roots of the system specified by the following BF 
equation: 4 


(E + 1)(E? + 6E + 25)y[n] = 3Ex[n] 


Determine the external and the internal stability of the system. 
Answers 


BIBO and asymptotically unstable 


EXERCISE E3.23 


Repeat Exercise E3.22 for oF 
(E —1)?(E +0.5)y[n] = (£7 +2E + 3)x{[n] * 


Answers 


BIBO and asymptotically unstable 


[Tif the development of discrete-time systems is parallel to that of continuous-time systems, we wonder why the parallel breaks down here. Why, 
for instance, are LHP and RHP not the regions demarcating stability and instability? The reason lies in the form of the characteristic modes. In 


continuous-time systems, we chose the form of characteristic mode as e4“, In discrete-time systems, for computational convenience, we choose the 
form to be y";. Had we chosen this form to be e’" where Vi= e’, then the LHP and RHP (for the location of Aj) again would demarcate stability 


and instability. The reason is that if y = eA |y¥| = 1 implies lel = 1, and therefore = jw. This shows that the unit circle in y plane maps into the 
imaginary axis in the A plane. 


[tlThis conclusion follows from the fact that (see Section B.7-4) 


ed co , 
Ze [ve |uin] = Doiat =T-ml lye] <1 


Moreover, if |y| = 1, the sum diverges and goes to co. These conclusions are valid also for the modes of the form n'y", 


3.11 INTUITIVE INSIGHTS INTO SYSTEM BEHAVIOR 


The intuitive insights into the behavior of continuous-time systems and their qualitative proofs, discussed in Section 2.7, also apply to discrete-time 
systems. For this reason, we shall merely mention here without discussion some of the insights presented in Section 2.7. 


The system's entire (zero-input and zero-state) behavior is strongly influenced by the characteristic roots (or modes) of the system. The system 
responds strongly to input signals similar to its characteristic modes and poorly to inputs very different from its characteristic modes. In fact, when 
the input is a characteristic mode of the system, the response goes to infinity, provided the mode is a nondecaying signal. This is the resonance 
phenomenon. The width of an impulse response h[n] indicates the response time (time required to respond fully to an input) of the system. It is the 


time constant of the system.[T] Discrete-time pulses are generally dispersed when passed through a discrete-time system. The amount of 
dispersion (or spreading out) is equal to the system time constant (or width of h[n]). The system time constant also determines the rate at which 
the system can transmit information. Smaller time constant corresponds to higher rate of information transmission, and vice versa. 


[tl This part of the discussion applies to systems with impulse response h[n] that is a mostly positive (or mostly negative) pulse. 


3.12 APPENDIX 3.1: IMPULSE RESPONSE FOR A SPECIAL CASE 


When ay = 0, Ag = balay becomes indeterminate, and the procedure needs to be modified slightly. When a, = 0, Q[E] can be expressed as 


EQUE] and Eq. (3.43) can be expressed as 
EQUE\h[n] = P(LE[n] = P[E)(£3[n — 1]} = EPLE4{n — 1] 


Hence 


OLElA[n] = PLEW[n — 1] 

In this case the input vanishes not for n = 1, but for n => 2. Therefore, the response consists not only of the zero-input term and an impulse Agd[n] 
(at n = 0), but also of an impulse A 8[n — 1] (at n = 1). Therefore 

h[n] = Apd[n] + A, d[n — 1] + y.[n]ufn] 

We can determine the unknowns Ag, Aj, and the N — 1 coefficients in y,[n] from the N + 1 number of initial values A[O], h[1],..., ALN], determined 


as usual from the iterative solution of the equation Q[E]h[n] = P[E}8[n].41 Similarly, if aj = ayy_4 = 0, we need to use the form A[n] = Agd[n] + 
A,8[n — 1] + Azd[n — 2] + y,[n]u[n]. The N + 1 unknown constants are determined from the N + 1 values A[0], [1],..., A[N], determined 
iteratively, and so on. 


[tH Olylis now an (N — 1)-order polynomial. Hence there are only N — 1 unknowns in y,[n]. 


3.13 SUMMARY 

This chapter discusses time-domain analysis of LTID (linear, time-invariant, discrete-time) systems. The analysis is parallel to that of LTIC systems, 
with some minor differences. Discrete-time systems are described by difference equations. For an Nth-order system, N auxiliary conditions must be 
specified for a unique solution. Characteristic modes are discrete-time exponentials of the form y” corresponding to an unrepeated root y, and the 
modes are of the form n! y” corresponding to a repeated root y. 


The unit impulse function 5[n] is a sequence of a single number of unit value at n = 0. The unit impulse response h[n] of a discrete-time system is 
a linear combination of its characteristic modes.!T] 


The zero-state response (response due to external input) of a linear system is obtained by breaking the input into impulse components and then 
adding the system responses to all the impulse components. The sum of the system responses to the impulse components is in the form of a sum, 
known as the convolution sum, whose structure and properties are similar to the convolution integral. The system response is obtained as the 
convolution sum of the input x[n] with the system's impulse response h[n]. Therefore, the knowledge of the system's impulse response allows us to 
determine the system response to any arbitrary input. 


LTID systems have a very special relationship to the everlasting exponential signal z” because the response of an LTID system to such an input 


signal is the same signal within a multiplicative constant. The response of an LTID system to the everlasting exponential input z” is H[z]z”, where 
H[z] is the transfer function of the system. 


Difference equations of LTID systems can also be solved by the classical method, in which the response is obtained as a sum of the natural and 
the forced components. These are not the same as the zero-input and zero-state components, although they satisfy the same equations, 
respectively. Although simple, this method is applicable to a restricted class of input signals, and the system response cannot be expressed as an 


explicit function of the input. These limitations diminish its value considerably in the theoretical study of systems. 


The external stability criterion, the bounded-input/bounded-output (BIBO) stability criterion, states that a system is stable if and only if every 
bounded input produces a bounded output. Otherwise the system is unstable. 


The internal stability criterion can be stated in terms of the location of characteristic roots of the system as follows: 


1. An LTID system is asymptotically stable if and only if all the characteristic roots are inside the unit circle. The roots may be repeated 
or unrepeated. 


2. An LTID system is unstable if and only if either one or both of the following conditions exist: (i) at least one root is outside the unit 
circle; (ii) there are repeated roots on the unit circle. 


3. An LTID system is marginally stable if and only if there are no roots outside the unit circle and some unrepeated roots on the unit 
circle. 


An asymptotically stable system is always BIBO stable. The converse is not necessarily true. 


[tlThere is a possibility of an impulse 8[n] in addition to characteristic modes. 


MATLAB SESSION 3: DISCRETE-TIME SIGNALS AND SYSTEMS 


MATLAB is naturally and ideally suited to discrete-time signals and systems. Many special functions are available for discrete-time data operations, 
including the stem, filter, and conv commands. In this session, we investigate and apply these and other commands. 


M3.1 Discrete-Time Functions and Stem Plots 


Consider the discrete-time function f[n] = e "5 cos (1tn/5)u[n]. In MATLAB, there are many ways to represent f[n] including M-files or, for 


particular n, explicit command line evaluation. In this example, however, we use an inline object 
>> £ = inline ('exp(-n/5) .*cos(pi*n/5).*(n>=0)','n'); 


A true discrete-time function is undefined (or zero) for noninteger n. Although inline object £ is intended as a discrete-time function, its present 
construction does not restrict n to be integer, and it can therefore be misused. For example, MATLAB dutifully returns 0.8606 to f (0.5) whena 
NaN (not-a-number) or zero is more appropriate. The user is responsible for appropriate function use. 


Next, consider plotting the discrete-time function f[n] over (—10 < n < 10). The stem command simplifies this task. 


>> n = (-10:10)'; 
>> stem(n, f(n),'k"'); 
>> xlabel ('n'); ylabel('f[n]"'); 


Here, stem operates much like the plot command: dependent variable £ (n) is plotted against independent variable n with black lines. The 
stem command emphasizes the discrete-time nature of the data, as Fig. M3.1 illustrates. 
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Figure M3.1: f[n] over (—10 < n < 10). 


For discrete-time functions, the operations of shifting, inversion, and scaling can have surprising results. Compare f[—2n] with f[—2n + 1]. Contrary 
to the continuous case, the second is not a shifted version of first. We can use separate subplots, each over (—10 < n < 10), to help illustrate this 
fact. Notice that unlike the plot command, the stem command cannot simultaneously plot multiple functions on a single axis; overlapping stem 
lines would make such plots difficult to read anyway. 


>> subplot (2,1,1); stem(n, £(-2*n), 'k'); ylabel('f[-2n]"'); 
b 


>> subplot(2,1,2); stem(n, £(-2*n+l),'k'); ylabel('f[-2n+1]'); xlabel('n'); 


The results are shown in Fig. M3.2. Interestingly, the original function f[n] can be recovered by interleaving samples of f[—2n] and f[—2n + 1] and 


then time-reflecting the result. 
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Figure M3.2: f[—2n] and f[—2n + 1] over (—10 < n < 10). 


IA 


Care must always be taken to ensure that MATLAB performs the desired computations. Our inline function £ is a case in point: although it correctly 
downsamples, it does not properly upsample (see Prob. 3.M-1). MATLAB does what it is told, but it is not always told how to do everything 
correctly! 


M3.2 System Responses Through Filtering 


MATLAB's £11ter command provides an efficient way to evaluate the system response of a constant coefficient linear difference equation 
represented in delay form as 


N 


N 
>> ayia — k] = So byxin — k] (M3.1) 
k=O 


k=O 
In the simplest form, filter requires three input arguments: a length—(N + 1) vector of feedforward coefficients [bo, 64,..., by], a length-(N + 1) 


vector of feedback coefficients [ag, a4,..., ay], and an input vector.[T] Since no initial conditions are specified, the output corresponds to the 
system's zero-state response. 


To serve as an example, consider a system described by y[n] — y[n — 1] + y[n — 2] = x[n]. When x[n] = d[n], the zero-state response is equal to 
the impulse response h[n], which we compute over (0 < n < 30). 


>> b [1 0 0]; a = [1 -1 1]; 

>> n (0:30) '; delta = inline ('n==0','n'); 
>> h = filter(b,a,delta(n)); 

>> stem(n,h,'k'); axis([-.5 30.5 -1.1 1.1]); 
>> xlabel ('n'); ylabel('h[n]"'); 


As shown in Fig. M3.3, h[n] appears to be (No = 6)—periodic for n => 0. Since periodic signals are not absolutely summable, =°, = —.o |A[n]] is not 
finite and the system is not BIBO stable. Furthermore, the sinusoidal input x[n] = cos (2T1n/6)u[n], which is (Ng = 6)—periodic for n = 0, should 
generate a resonant zero-state response. 


>> x = inline ('cos(2*pi*n/6).* (n>=0)','n'); 
>> y = filter(b,a,x(n)); 
>> stem(n,y,'k'); xlabel('n'); ylabel('y[n]"'); 
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Figure M3.3: h[n] for y[n] — y[n — 1] + y[n — 2] = x{[n]. 


The response's linear envelope, shown in Fig. M3.4, confirms a resonant response. The characteristic equation of the system is y2 — Y + 1, which 
has roots y = e*//3. Since the input x[n] = cos (2Ttn/6)u[n] = (1/2)(e/™/3 + e/T™/3)uTn] coincides with the characteristic roots, a resonant 
response is guaranteed. 
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Figure M3.4: Resonant zero-state response y[n] for x[n] = cos(211/n/6)u[n]. 


By adding initial conditions, the £i11ter command can also compute a system's zero-input response and total response. Continuing the preceding 
example, consider finding the zero-input response for y[—1] = 1 and y[—2] = 2 over (0 < n < 30). 

>> zi = filtic(b,a,[1 2]); 
>> y 0 = filter(b,a,zeros(si 
>> stem(n,y 0,'k"'); xlabel(' 
>> axis([-0.5 30.5 =-2Z.1 2.1) 


ze(n)),z 1); 
age ylabel('y {0} [n]'); 


, 


There are many physical ways to implement a particular equation. MATLAB implements Eq. (M3.1) by using the popular direct form II transposed 


structure.!1] Consequently, initial conditions must be compatible with this implementation structure. The signal processing toolbox function filtic 
converts the traditional y[-1], y[-2],..., y[—N] initial conditions for use with the £i:1ter command. An input of zero is created with the zeros 
command. The dimensions of this zero input are made to match the vector n by using the size command. Finally, -{ } forces subscript text in 
the graphics window, and *{ } forces superscript text. The results are shown in Fig. M3.5. 
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Figure M3.5: Zero-input response yo[n] for y[—1] = 1 and y[—2] = 2. 
Given y[—1] = 1 and y[—2] = 2 and an input x[n] = cos (2Trn/6)u[n], the total response is easy to obtain with the £ilter command. 
>> y_ total = filter(b,a,x(n),z_1); 


Summing the zero-state and zero-input response gives the same result. Computing the total absolute error provides a check. 


>> sum(abs(y total-(y + y_0))) 
ans = 1.8430e-014 


Within computer round-off, both methods return the same sequence. 


M3.3 A Custom Filter Function 


The f£iltic command is only available if the signal processing toolbox is installed. To accommodate installations without the signal processing 
toolbox and to help develop your MATLAB skills, consider writing a function similar in syntax to filter that directly uses the ICS y[-1], y[- 
2]...-y[-N]. Normalizing a9 = 1 and solving Eq. (M3.1) for y[n] yields 


N N 
yin] = > hxfn —k1— So ayin - 4] 


k=0 k=1 
This recursive form provides a good basis for our custom filter function. 


function [y] = MS3Pl(b, a, x, yi); 
% MS3P1.m : MATLAB Session 3, Program 1 


% Function M-file filters data x to create y 

% INPUTS: b = vector of feedforward coefficients 

% a = vector of veedback coefficients 

& x = input data vector 

% yi = vector of initial conditions [y[-1], y[-2], ...] 

% OUTPUTS: y = vector of filtered output data 

yi = flipud(yi(:)); % Properly format IC's. 

y = [yi;zeros(length(x),1)]; % Preinitialize y, beginning with IC's 

x = [zeros(length(yi),1);x(:)]; % Append x with zeros to match size of y. 
b = b/a(l);a = a/a(l1); % Normalize coefficients. 


for n = length(yi)+l:length(y), 


for nb = O:length(b)-1, 

y(n) = y(n) + b(nbt+1)*x(n-na); % Feedforward terms. 
end 

for na = 1l:length(a)-1 

y(n) = y(n) - a(natl)*y(n-na); % Feedback terms. 
end 

end 


2 


y = y(length) (yi)+l:end); % Strip of IC's for final output. 


Most instructions in MS3P1 have been discussed; now we turn to the £l1ipud instruction. The flip up-down command f1lipud reverses the order of 
elements in a column vector. Although not used here, the flip left-right command flipir reverses the order of elements in a row vector. Note that 
typing help filename displays the first contiguous set of comment lines in an M-file. Thus, it is good programming practice to document M-files, 
as in MS3P1, with an initial block of clear comment lines. 


As an exercise, the reader should verify that MS3P1 correctly computes the impulse response h[n], the zero-state response y[n], the zero-input 
response yo[n], and the total response y[n] + yo[n]. 


M3.4 Discrete-Time Convolution 


Convolution of two finite-duration discrete-time signals is accomplished by using the conv command. For example, the discrete-time convolution of 
two length-4 rectangular pulses, g[n] = (u[n] — u[n — 4]) * (u[n] — u[n — 4]), is a length-(4 + 4 — 1 = 7) triangle. Representing u[n] — u[n — 4] by 
the vector [1, 1, 1, 1], the convolution is computed by: 


>> conv ( [1 111], [1 1 1 1]) 
ans = 1 2 3 4 3 2 1 


Notice that (u[n+4] — u[n])*(u[n] — u[n—4]) is also computed by conv ([1 1 1 1], [1 1 1 1]) and obviously yields the same result. The 
difference between these two cases is the regions of support: (0 < n < 6) for the first and (—4 < n < 2) for the second. Although the conv 
command does not compute the region of support, it is relatively easy to obtain. If vector w begins at n = ny, and vector v begins at n = ny, then 
conv (w, v) begins atn =ny + ny. 


In general, the conv command cannot properly convolve infinite-duration signals. This is not too surprising, since computers themselves cannot 
store an infinite-duration signal. For special cases, however, conv can correctly compute a portion of such convolution problems. Consider the 
common case of convolving two causal signals. By passing the first N samples of each, conv returns a length-(2N — 1) sequence. The first N 
samples of this sequence are valid; the remaining N — 1 samples are not. 


To illustrate this point, reconsider the zero-state response y[n] over (0 < n < 30) for system y[n] — y[n — 1] + y[n — 2] = x[n] given input x[n] = 
cos (211n/6)u[n]. The results obtained by using a filtering approach are shown in Fig. M3.4. 


The response can also be computed using convolution according to y[n] = h[n]*x[n]. The impulse response of this system isl] 


ks 
hi[n| = {0s rn/3) + Fi sin (7/3) > uln| 
Both hA[n] and x[n] are causal and have infinite duration, so conv can be used to obtain a portion of the convolution. 


>> h = inline(' (cos (pi*n/3)+sin(pi*n/3) /sqrt(3)).* (n>=0)', 'n'); 
>> y = conv(h(n), x(n)); 
>> stem([0:60],y,'k'); xlabel('n'); ylabel('y[n]'); 


The conv output is fully displayed in Fig. M3.6. As expected, the results are correct over (0 < n < 30). The remaining values are clearly incorrect; 
the output envelope should continue to grow, not decay. Normally, these incorrect values are not displayed. 


>> stem(n,y(1:31),'k'); xlabel('n'); ylabel('y[n]'); 


yin] 


20 
0 10 20 30 40 50 60 


i 
Figure M3.6: y[n] for x[n] = cos (24n/6)u[n] computed with conv. 


The resulting plot is identical to Fig. M3.4. 


[Tit is important to pay close attention to the inevitable notational differences found throughout engineering documents. In MATLAB help 
documents, coefficient subscripts begin at 1 rather than 0 to better conform with MATLAB indexing conventions. That is, MATLAB labels ag as a 
(1), bg aSb (1), and so forth. 


[tlimplementation structures, such as direct form II transposed, are discussed in Chapter 4. 


[tl Techniques to analytically determine h[n] are presented in Chapter 5. 


PROBLEMS 
3.1.1. Find the energy of the signals depicted in Figs. P3.1-1. 
x[n] a[n] 


(a) (b) 


(c) (d) 
Figure P3.1-1 


3.1.2. Find the power of the signals illustrated in Figs. P3.1-2. 


stv] 


ball Aleit alt 


- ofl [fl afl. 
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Figure P3.1-2 
3.1.3 Show that the power of a signal Del(2T/No)n jg |D|2. Hence, show that the power of a signal 
No-1 fo-I 
x[a] ee he D,eit(2x/No)n is Py = DS ID, /? 
r=f r=0 
Use the fact that 
No-1 
Pe ei (r—m)2rk/No = No r=m 
0 otherwise 
=0 
3.1.4 
a. Determine even and odd components of the signal x[n] = (0.8)"u[n]. 
b. Show that the energy of x[n] is the sum of energies of its odd and even components found in part (a). 
c. Generalize the result in part (b) for any finite energy signal. 
3.1.5 


a. If x,[n] and xg[n] are the even and the odd components of a real signal x[n], then show that Ex, = Ex, =0.5Ey. 


b. Show that the cross-energy of xg and xg is zero, that is, 
aw 


>. x,[n]x,[n] = 0 


a= 0O 


3.2.1 _ If the energy of a signal x[n] is Ey, then find the energy of the following: 


a. x[—n] 
b. x[n — m] 
c. x[m — n] 


d. Kx[n] (m integer and K constant) 
3.2.2 _ If the power of a periodic signal x[n] is Py, find and comment on the powers and the rms values of the following: 
a. —x[n] 
b. x[-n] 
c. x[n — m] (m integer) 
d. cx[n] 
e. x[m — n] (m integer) 
3.2.3 For the signal shown in Fig. P3.1-1b, sketch the following signals: 
a. x[-n] 
b. x[n + 6] 


c. x[n — 6] 


f. x[3 — n] 
3.2.4 Repeat Prob. 3.2-3 for the signal depicted in Fig.P3.1-1c. 
3.3.1. Sketch, and find the power of, the following signals: 


a. (1)? 

6. 4) 

c. u[n] 

d. (—1)"u[n] 
F"+3 

o. La he 


3.3.2 Show that 
a. 8[n] + 8[n — 1] = u[n] — u[n — 2] 


7 l 1M 
2-1 gin (—— = — 2" sin{ — = 
2 sin( 3 ) ul) 5 sin( 5 ulm 1] 
c. n(n — 1)y"u[n] = n(n — 1)y"u[n — 2] 


(u[n] + (—1)"u[n]) sin (=) =0 


(ulnJ+(—1)"*"u[n]) cos (=) =0 
e. foralln ’ 
3.3.3. Sketch the following signals: 
a. u[n — 2] — u[n - 6] 
b. n{u[n] — u[n — 7]} 
c. (n — 2) {u[n — 2] — u[n — 6]} 
d. (—n + 8){u[n — 6] — u[n — 9} 


e. (n — 2){u[n — 2] — u[n — 6} + (— n+ 8){u[n — 6] — u[n — 9}} 
3.3.4 Describe each of the signals in Fig. P3.1-1 by a single expression valid for all n. 


3.3.5 The following signals are in the form en, Express them in the form y”: 


a. e70.5n 


d. e/t™n 


In each case show the locations of A and y in the complex plane. Verify that an exponential is growing if y lies outside 
the unit circle (or if lies in the RHP), is decaying if y lies within the unit circle (or if \ lies in the LHP), and has a 
constant amplitude if y lies on the unit circle (or if A lies on the imaginary axis). 


An 


3.3.6 Express the following signals, which are in the form e®”, in the form”: 


a. e (1+) 
b. e (1-1) 


a(t4im)n 


d. e(1-/™)n 


3.3.7 


3.4.1 


3.4.2 


3.4.3 


3.4.4 


3.4.5 


3.4.6 


3.4.7 


3.4.8 


e. e ltti(T/3)]n 


f. elt-i(r/3)In 


The concepts of even and odd functions for discrete-time signals are identical to those of the continuous-time signals discussed in 
Section 1.5. Using these concepts, find and sketch the odd and the even components of the following: 
a. u[n] 


b. nu[n] 


. (=) 
sin| —— 
Cc. 4 


: (=) 
d: hl: 


A cash register output y[n] represents the total cost of n items rung up by a cashier. The input x[n] is the cost of the nth item. 
a. Write the difference equation relating y[n] to x[n]. 


b. Realize this system using a time-delay element. 


Let p[n] be the population of a certain country at the beginning of the nth year. The birth and death rates of the population during 
any year are 3.3 and 1.3%, respectively. If i[n] is the total number of immigrants entering the country during the nth year, write the 
difference equation relating p[n + 1], p[n], and i[n]. Assume that the immigrants enter the country throughout the year at a uniform 
rate. 


A moving average is used to detect a trend of a rapidly fluctuating variable such as the stock market average. A variable may 
fluctuate (up and down) daily, masking its long-term (secular) trend. We can discern the long-term trend by smoothing or averaging 
the past N values of the variable. For the stock market average, we may consider a 5-day moving average y[n] to be the mean of 
the past 5 days' market closing values x[n], x[n - 1],..., x[n — 4]. 


a. Write the difference equation relating y[n] to the input x[n]. 


b. Use time-delay elements to realize the 5-day moving-average filter. 


The digital integrator in Example 3.7 is specified by 
y[n] — y[n — 1] = Tx[n] 


If an input u[n] is applied to such an integrator, show that the output is (n + 1)Tu[n], which approaches the desired ramp nTu[n] as 
T= 0. 


Approximate the following second-order differential equation with a difference equation. 


dy +a dy + ayy(t) = x(t) 
— aye y as J 
a rr oy 


The voltage at the nth node of a resistive ladder in Fig. P3.4-6 is v[n] 


Figure P3.4-6 


(n = 0, 1, 2,..., N). Show that v[n] satisfies the second-order difference equation 


1 
u[n+2]—Av[n+l]+v[n]=0 A=24+- 

a 
[Hint: Consider the node equation at the nth node with voltage v[n].] 


Determine whether each of the following statements is true or false. If the statement is false, demonstrate by proof or example why 
the statement is false. If the statement is true, explain why. 


a. A discrete-time signal with finite power cannot be an energy signal. 
b. A discrete-time signal with infinite energy must be a power signal. 
c. The system described by y[n] = (n+1)x[n] is causal. 

d. The system described by y[n — 1] = x[n] is causal. 


e. If an energy signal x[n] has energy E, then the energy of x[an] is E/|a]. 


A linear, time-invariant system produces output y;[n] in response to input x4[n], as shown in Fig. P3.4-8. Determine and sketch the 
output y2[n] that results when input x2[n] is applied to the same system. 


x\[n] 


x [n] 


yy le] 
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— 
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yoln] 


Figure P3.4-8: Input-output plots. 


3.4.9 A system is described by 
x 
¥., x[k](6[n — k] + 5[n + k]) 


yln] =} 


k= 


a. 


b. 


e. 


f. 


oo 
Explain what this system does. 

Is the system BIBO stable? Justify your answer. 
Is the system linear? Justify your answer. 

Is the system memoryless? Justify your answer. 
Is the system causal? Justify your answer. 


Is the system time invariant? Justify your answer. 


3.4.10 A discrete-time system is given by 


y[a + 1] = 


a. 


b. 


o 


x[n] 


x[n + 1] 


Is the system BIBO stable? Justify your answer. 
Is the system memoryless? Justify your answer. 


Is the system causal? Justify your answer. 


3.4.11 Explain why the continuous-time system y(t) = x(2t) is always invertible and yet the corresponding discrete-time system y[n] = 
x[2n] is not invertible. 


3.4.12 | Consider the input-output relationships of two similar discrete-time systems: 
1 
yi [2] = sin (Fn + 1) x[n] 


and 


y3[n] = sin (Fm 4 1)) x[n] 


Explain why x[n] can be recovered from y4[n] yet x[n] cannot be recovered from yo[n]. 


3.4.13 Consider a system that multiplies a given input by a ramp function, r[n]. That is, y[n] = x[n]r[n]. 


a. 
b. 
Cc. 
d. 


e. 


Is the system BIBO stable? Justify your answer. 
Is the system linear? Justify your answer. 
Is the system memoryless? Justify your answer. 
Is the system causal? Justify your answer. 


Is the system time invariant? Justify your answer. 


3.4.14 A jet-powered car is filmed using a camera operating at 60 frames per second. Let variable n designate the film frame, where n = 0 
corresponds to engine ignition (film before ignition is discarded). By analyzing each frame of the film, it is possible to determine the 
car position x[n], measured in meters, from the original starting position x[0] = 0. 


3.4.15 
3.5.1 


3.5.2 


3.5.3 


3.5.4 


3.5.5 


3.6.1 


3.6.2 


3.6.3 


3.6.4 


3.6.5 


From physics, we know that velocity is the time derivative of position, 
d 
v(f) = —x(ft) 
dt ( 
Furthermore, we know that acceleration is the time derivative of velocity, 


ns 
a( —a 


We can estimate the car velocity from the film data by using a simple difference equation v[n] = k(x[n] — x[n — 1]) 
a. Determine the appropriate constant k to ensure v[n] has units of meters per second. 


b. Determine a standard-form constant coefficient difference equation that outputs an estimate of acceleration, a[n], 
using an input of position, x[n]. Identify the advantages and shortcomings of estimating acceleration a(t) with a[n]. 
What is the impulse response h[n] for this system? 


Do part (a) of Prob. 3.M-2. 
Solve recursively (first three terms only): 
a. y[n + 1] — 0.5y[n] = 0, with y[—1] = 10 
b. y[n + 1] + 2y[n] = x[n + 1], with x[n] = e-"u[n] and y[—1] = 0 


Solve the following equation recursively (first three terms only): 
y[n] — 0.6y[n — 1] — 0.16y[n — 2] = 0 


with 
y[—1] = —25, y[—2] = 0. 


Solve recursively the second-order difference Eq. (3.10b) for sales estimate (first three terms only), assuming y[—1] = y[—2] = 0 and 
x[n] = 100u[n]. 


Solve the following equation recursively (first three terms only): 
y[n + 2] + 3y[n + 1] + 2y[n] 


= x[n + 2] + 3x[n + 1] + 3x[n] 
with x[n] = (3)u[n], y[—1] = 3, and y[—2] = 2 


Repeat Prob. 3.5—4 for 
y[n] + 2y[n — 1] + y[n —2] = 2x[n]—x[n—- 1] 


with x[n] = (3)~"u[n], y[—1] = 2, and y[—2] = 3. 


Solve 
y[n + 2] + 3y[n + 1] + 2y[n] =0 


if y[—1] = 0, y[—2] = 1. 


Solve 
y[n + 2] + 2y[n + 1] + y[n] =0 


if y_—1] = 1, y[—2] = 1. 
Solve 

y[n + 2] — 2y[n + 1] + 2y[n] = 0 
if y[— 1] = 1, yl-2] = 0. 


For the general Nth-order difference Eq. (3.17b), letting 
4, =a) =::-=>=adyn_1 =0 


results in a general causal Nth-order LTI nonrecursive difference equation 
yln] = box[n] + byx[n — 1] +>: 
+ by_x[n — N + 1] + byxin — N] 


Show that the characteristic roots for this system are zero, and hence, the zero-input response is zero. Consequently, the total 
response consists of the zero-state component only. 


Leonardo Pisano Fibonacci, a famous thirteenth-century mathematician, generated the sequence of integers {0, 1, 1, 2, 3, 5, 8, 13, 
21, 34,....} while addressing, oddly enough, a problem involving rabbit reproduction. An element of the Fibonacci sequence is the 
sum of the previous two. 


a. Find the constant-coefficient difference equation whose zero-input response f[n] with auxiliary conditions f[1] = 0 and 
f[2] = 1 is a Fibonacci sequence. Given f[n] is the system output, what is the system input? 


3.6.6 


3.6.7 


3.7.1 


3.7.2 


3.7.3 


3.7.4 


3.8.1 


3.8.2 


3.8.3 


3.8.4 


3.8.5 


3.8.6 


3.8.7 


3.8.8 


3.8.9 


b. What are the characteristic roots of this system? Is the system stable? 


c. Designating 0 and 1 as the first and second Fibonacci numbers, determine the fiftieth Fibonacci number. Determine the 
thousandth Fibonacci number. 


Find v[n], the voltage at the nth node of the resistive ladder depicted in Fig. P3.4-6, if V = 100 volts and a = 2. [Hint 1: Consider the 
node equation at the nth node with voltage v[n]. Hint 2: See Prob. 3.4-6 for the equation for v[n]. The auxiliary conditions are v[0] = 
100 and v[N] = 0.] 


Consider the discrete-time system y[n] + y[n — 1] + 0.25y[n — 2] = \/x[n — 8]. Find the zero input response, yo[n], if yo[—1] = 1 
and yo[1] = 1 


Find the unit impulse response h[n] of systems specified by the following equations: 
a. y[n + 1] + 2y[n] = x[n] 
b. y[n] + 2y[n — 1] = x[n] 


Repeat Prob. 3.7—1 for 
(E? —6E +9)y[n] = Ex{[n] 


Repeat Prob. 3.7—1 for 
yln] — 6y[n — 1] + 25y[n — 2] = 


2x[n] — 4x[n — 1] 


a. For the general Nth-order difference Eq. (3.17), letting 
ao = ad) = dQ) = ++: = ay_1 =0 


results in a general causal Nth-order LTI nonrecursive difference equation 


y[n] = box[n] + bx[n — 1] +--- 
+by_ixin — N + 1] + byxin — N] 


Find the impulse response h[n] for this system. [Hint: The characteristic equation for this case is y” = 0. Hence, all the 
characteristic roots are zero. In this case, y,[n] = 0, and the approach in Section 3.7 does not work. Use a direct 


method to find A[n] by realizing that h[n] is the response to unit impulse input.] 


b. Find the impulse response of a nonrecursive LTID system described by the equation 
y[n] = 3x[n] — Sx[n — 1] — 2x[n — 3] 


Observe that the impulse response has only a finite (N) number of nonzero elements. For this reason, such systems 
are called finite-impulse response (FIR) systems. For a general recursive case [Eq. (3.24)], the impulse response has 
an infinite number of nonzero elements, and such systems are called infinite-impulse response (IIR) systems. 


Find the (zero-state) response y[n] of an LTID system whose unit impulse response is 


A{n] = (—2)"u[n — 1] 


and the input is x[n] = e~"u[n + 1]. Find your answer by computing the convolution sum and also by using the convolution table 
(Table 3.1). 


Find the (zero-state) response y[n] of an LTID system if the input is x[n] = 3"-1uINn + 2] and 
h{n] = 4[8[2 — 2] — (—2)"*"Jula — 3] 


Find the (zero-state) response y[n] of an LTID system if the input x[n] = (3)°*2u[n + 1], and 


h{n] = [(2)""? + 3(—5)"*? Jala — 1] 


Find the (zero-state) response y[n] of an LTID system if the input x[n] = (3) "*2u[n + 3], and 
h{n] = 3(n — 2)(2)" > uln — 4] 


Find the (zero-state) response y[n] of an LTID system if its input x[n] = (2)"u[n — 1], and 
x 
h[n] = (3)" cos (Fn - 0.5) u[n] 


Find your answer using only Table 3.1, the convolution table. 

Derive the results in entries 1, 2 and 3 in Table 3.1. [Hint: You may need to use the information in Section B.7-4.] 
Derive the results in entries 4, 5, and 6 in Table 3.1. 

Derive the results in entries 7 and 8 in Table 3.1. [Hint: You may need to use the information in Section B.7-4.] 


Derive the results in entries 9 and 11 in Table 3.1. [Hint: You may need to use the information in Section B.7-4.] 


3.8.10 


3.8.11 


3.8.12 


3.8.13 


3.8.14 


3.8.15 


3.8.16 


3.8.17 


3.8.18 


Find the total response of a system specified by the equation 
y[n + 1] + 2y[n] = x[n + 1] 


if y[—1] = 10, and the input x[n] = e~"u[n]. 

Find an LTID system (zero-state) response if its impulse response A[n] = (0.5)"u[n], and the input x[n] is 
a. 2"u[n] 
b. 2"-3u[n] 
c. 2"u[n — 2] 

[Hint: You may need to use the shift property (3.61) of the convolution.] 


For a system specified by equation 
y[2] = x[n] — 2x[n — 1] 


Find the system response to input x[n] = u[n]. What is the order of the system? What type of system (recursive or nonrecursive) is 


this? Is the knowledge of initial condition(s) necessary to find the system response? Explain. 


a. A discrete-time LTI system is shown in Fig. P3.8-13. Express the overall impulse response of the system, A[n], in 
terms of hy[n], h2[n], h3[n], hg[n], and hs[n]. 


b. Two LTID systems in cascade have impulse response h4[n] and hg[n], respectively. Show that if h4[n] = (0.9)"u[n] — 
0.5(0.9)"~‘u[n —1] and hg[n] = (0.5)"u[n] — 0.9(0.5)"~tu[n — 1], the cascade system is an identity system. 


x[n] yin] 


Figure P3.8-13 


a. Show that for a causal system, Eq. (3.70b) can also be expressed as 
n 


g[n] = So hin — k] 


#=0 


b. How would the expressions in part (a) change if the system is not causal? 


In the savings account problem described in Example 3.4, a person deposits $500 at the beginning of every month, starting at n = 
0 with the exception at n = 4, when instead of depositing $500, she withdraws $1000. Find y[n] if the interest rate is 1% per month 
(r = 0.01). 


To pay off a loan of M dollars in N number of payments using a fixed monthly payment of P dollars, show that 
rM 


~ 1-G4try* 
where r is the interest rate per dollar per month. [Hint: This problem can be modeled by Eq. (3.9a) with the payments of P dollars 
starting at n = 1. The problem can be approached in two ways (1) Consider the loan as the initial condition yo[0] = —M, and the 
input x[n] = Pu[n — 1]. The loan balance is the sum of the zero-input component (due to the initial condition) and the zero-state 


component h[n] * x[n]. (2) Consider the loan as an input —M at n = 0 along with the input due to payments. The loan balance is 
now exclusively a zero-state component h[n] * x[n]. Because the loan is paid off in N payments, set y[N] = 0.] 


A person receives an automobile loan of $10,000 from a bank at the interest rate of 1.5% per month. His monthly payment is $500, 
with the first payment due one month after he receives the loan. Compute the number of payments required to pay off the loan. 
Note that the last payment may not be exactly $500. [Hint: Follow the procedure in Prob. 3.8—16 to determine the balance y[n]. To 
determine N, the number of payments, set y[N] = 0. In general, N will not be an integer. The number of payments K is the largest 
integer < N. The residual payment is |y[A]].] 


Using the sliding-tape algorithm, show that 
a. u[n] * u[n] = (n + 1)u[n] 


b. (u[n] — u[n — m))* u[n] = (n + 1)u[n] — (n — m+ 1)u[n — m] 


3.8.19 Using the sliding-tape algorithm, find x[n] * g[n] for the signals shown in Fig. P3.8-19. 
x[n] 
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Figure P3.8-19 
3.8.20 Repeat Prob. 3.8-19 for the signals shown in Fig. P3.8-20. 


a{w) air) 


“) 


sett ti, +t. 


10 — 


Figure P3.8-20 


3.8.21 Repeat Prob. 3.8-19 for the signals depicted in Fig. P3.8-21. 
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Figure P3.8-21 


3.8.22 | The convolution sum in Eq. (3.63) can be expressed in a matrix form as 


y[O]} | ALO} ) GQ wa O x[0] 
yi} | ALY h{O| 0 scnx x{[1] 
yin]} [Alm] Afan-—1]... 5... ALO) [fa] 

Se eee 

y H f 

or 

y=Hf 

and 

f=H'y 


Knowing h[n] and the output y[n], we can determine the input x[n]. This operation is the reverse of the convolution and is known as 
the deconvolution. Moreover, knowing x[n] and y[n], we can determine h[n]. This can be done by expressing the foregoing matrix 
equation as n + 1 simultaneous equations in terms of n + 1 unknowns 4A[0], A[1],..., A[n]. These equations can readily be solved 
iteratively. Thus, we can synthesize a system that yields a certain output y[n] for a given input x[n]. 


a. Design a system (i.e., determine h[n]) that will yield the output sequence (8, 12, 14, 15, 15.5, 15.75,...) for the input 
sequence (1, 1, 1, 1, 1, 1,...). 


b. For a system with the impulse response sequence (1, 2, 4,...), the output sequence was (1, 7/3, 43/9,...). Determine 
the input sequence. 


3.8.23 A second-order LTID system has zero-input response 
yoln] = [3, 24. 24, 24....] 


© 
k 
= >» {2+ (4) \ b[n ki] 
k=0 
a. Determine the characteristic equation of this system, agy? + ayy + a2 =0. 


b. Find a bounded, causal input with infinite duration that would cause a strong response from this system. Justify your 
choice. 


c. Find a bounded, causal input with infinite duration that would cause a weak response from this system. Justify your 
choice. 


3.8.24  AnLTID filter has an impulse response function given by h4[n] = 5[n + 2] — d[n — 2]. A second LTID system has an impulse 
response function given by hg[n] = n(u[n + 4] — u[n — 4)). 


a. Carefully sketch the functions h4[n] and hg[n] over (—10 < n < 10). 


b. Assume that the two systems are connected in parallel as shown in Fig. P3.8-24. Determine the impulse response 
hp[n] for the parallel system in terms of h4[n] and hg[n]. Sketch hp[n] over (—10 < n < 10). 


Figure P3.8-24: Parallel and series system connections. 


c. Assume that the two systems are connected in cascade as shown in Fig. P3.8-24. Determine the impulse response 
h,[n] for the cascade system in terms of hy[n] and hg[n]. Sketch h,[n] over (—10 < n < 10). 


3.8.25 This problem investigates an interesting application of discrete-time convolution: the expansion of certain polynomial expressions. 


a. By hand, expand (z° +z724+Zz+ 1)2. Compare the coefficients to [1, 1, 1, 1] * [1, 1, 1, 1]. 


b. Formulate a relationship between discrete-time convolution and the expansion of constant-coefficient polynomial 
expressions. 


c. Use convolution to expand (z~4 — 2z7° + 3z72)4. 
d. Use convolution to expand (z® +274 +3z2 + 5)2(z-4 — 572+ 13). 


3.8.26 Joe likes coffee, and he drinks his coffee according to a very particular routine. He begins by adding two teaspoons of sugar to his 
mug, which he then fills to the brim with hot coffee. He drinks 2/3 of the mug's contents, adds another two teaspoons of sugar, and 
tops the mug off with steaming hot coffee. This refill procedure continues, sometimes for many, many cups of coffee. Joe has noted 
that his coffee tends to taste sweeter with the number of refills. 


Let independent variable n designate the coffee refill number. In this way, n = 0 indicates the first cup of coffee, n = 1 is the first 
refill, and so forth. Let x[n] represent the sugar (measured in teaspoons) added into the system (a coffee mug) on refill n. Let y[n] 
designate the amount of sugar (again, teaspoons) contained in the mug on refill n. 


a. The sugar (teaspoons) in Joe's coffee can be represented using a standard second-order constant coefficient 
difference equation y[n] + ayy[n — 1] + agy[n — 2] = box[n] + byx[n — 1] + box[n — 2]. Determine the constants a4, 
ao, bo, by, and bo. 


b. Determine x[n], the driving function to this system. 


c. Solve the difference equation for y[n]. This requires finding the total solution. Joe always starts with a clean mug from 
the dishwasher, so y[—1] (the sugar content before the first cup) is zero. 


d. Determine the steady-state value of y[n]. That is, what is y[n] as n — oo? If possible, suggest a way of modifying x[n] 
so that the sugar content of Joe's coffee remains a constant for all nonnegative n. 


3.8.27. A-system is called complex if a real-valued input can produce a complex-valued output. Consider a causal complex system 
described by a first-order constant coefficient linear difference equation: 


(GE + 0.5) y[n] = (—SE)x[n] 
a. Determine the impulse response function h[n] for this system. 
b. Given input x[n] = u[n — 5] and initial condition yo[—1] = j, determine the system's total output y[n] for n = 0. 
3.8.28 A discrete-time LTI system has impulse response function A[n] = n(u[n — 2] — u[n + 2]). 
a. Carefully sketch the function h[n] over (—5 < n < 5). 


b. Determine the difference equation representation of this system, using y[n] to designate the output and x[n] to 
designate the input. 


3.8.29 Do part (a) of Prob. 3.M-3. 


3.8.30 | Consider three discrete-time signals: x[n], y[n], and z[n]. Denoting convolution as *, identify the expression(s) that is(are) 
equivalent to x[n](y[n] * z[n]): 


a. (x[n] * y[n]})z[n] 


3.9.1 


3.9.2 


3.9.3 


3.9.4 


3.9.5 


3.9.6 


3.9.7 


3.9.8 


3.10.1 


3.10.2 


b. (x[n]y[n]) * (x[n]z[n]) 
c. (x[n]y[n]) * z[n] 
d. none of the above 


Justify your answer! 


Use the classical method to solve 
y[n + 1] + 2y[n] = x[n + 1] 


with the input x[n] = e~"u[n], and the auxiliary condition y[0] = 1. 


Use the classical method to solve 
y[n] + 2y[n — 1] = x[n — 1] 


with the input x[n] = e~"u[n] and the auxiliary condition y[—1] = 0. [Hint: You will have to determine the auxiliary condition y[0] by 


using the iterative method.] 


a. Use the classical method to solve 
y[n + 2] + 3y[n + 1] + 2y[n] = 


x[n + 2] + 3x[n + 1] + 3xI[n] 
with the input x[n] = (3)” and the auxiliary conditions y[0] = 1, y[1] = 3. 
b. Repeat part (a) for auxiliary conditions y[—1] = y[—2] = 1. [Hint: Use the iterative method to determine to y[0] and y[1].] 


Use the classical method to solve 
y[z] + 2y[z — 1] + y[n —2] = 


2x[n] — x[n — 1] 
with the input x[n] = 37” u[n] and the auxiliary conditions y[0] = 2 and y[1] = — 13/3. 


Use the classical method to find the following sums: 


Repeat Prob. 3.9-5 to find =" ,-9kr*. 


Use the classical method to solve 
(EF? — E +0.16)y[n] = Ex{[n] 


with the input x[n] = (0.2)"u[n] and the auxiliary conditions y[0] = 1, y[1] = 2. [Hint: The input is a natural mode of the system.] 


Use the classical method to solve 
(EF? — E +0.16)y[n] = Ex{[n] 


with the input 


x[n]=cos (Fn 4+ “) u[n] 


and the initial conditions y[—1] = y[—2] = 0. [Hint: Find y[0] and y[1] iteratively.] 


In Section 3.10 we showed that for BIBO stability in an LTID system, it is sufficient for its impulse response h[n] to satisfy Eq. 
(3.90). Show that this is also a necessary condition for the system to be BIBO stable. In other words, show that if Eq. (3.90) is not 
satisfied, there exists a bounded input that produces unbounded output. [Hint: Assume that a system exists for which h[n] violates 
Eq. (3.90), yet its output is bounded for every bounded input. Establish the contradiction in this statement by considering an input 
X[n] defined by x[n; — m] = 1 when A[m] > 0 and x[n, — m] = —1 when h[m] < 0, where n, is some fixed integer.] 


Each of the following equations specifies an LTID system. Determine whether each of these systems is BIBO stable or unstable. 
Determine also whether each is asymptotically stable, unstable, or marginally stable. 


a. y[nt2]+0.6 y[n+1]—0.16y[n] = x[n+1]—2x{n] 
b. y[n]+3y[n—1]+2y[n—2] = x[n—1]+2x[n—2] 


c. (E — 1)* (E+ 1/2) y[n] = x{[n] 


d. y[n]+2y[n—1]+0.96y[n—2] = x[n] 
e. y[n]ty[n—1]—2y[n—-2] = x[n] + 2x[n—-1] 
f. (E? — 1)(E* + 1)y[n] = x{n] 


3.10.3 Consider two LTIC systems in cascade, as illustrated in Fig. 3.23. The impulse response of the system Sj, is hy[n] = 2” u[n] and 


the impulse response of the system So is hg[n] = d[n] — 28[n — 1]. Is the cascaded system asymptotically stable or unstable? 
Determine the BIBO stability of the composite system. 


3.10.4 Figure P3.10-4 locates the characteristic roots of nine causal, LTID systems, labeled A through |. Each system has only two roots 


and is described using operator notation as Q(E)y[n] = P(E)x[n]. All plots are drawn to scale, with the unit circle shown for 
reference. For each of the following parts, identify all the answers that are correct. 


a. Identify all systems that are unstable. 


b. Assuming all systems have P(E) = E?, identify all systems that are real. Recall that a real system always generates a 
real-valued response to a real-valued input. 


c. Identify all systems that support oscillatory natural modes. 
d. Identify all systems that have at least one mode whose envelop decays at a rate of 27”. 


e. Identify all systems that have only one mode. 
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3.10.5 A discrete-time LTI system has impulse response given by 


a 
h{n] = 8{n] + (4) ufn — 1) 
a. Is the system stable? Is the system causal? Justify your answers. 
b. Plot the signal x[n] = u[n — 3] — u[n + 3]. 


c. Determine the system's zero-state response y[n] to the input x[n] = u[n — 3] — u[n + 3]. Plot y[n] over (-10 <n < 
10). 


3.10.6 An LTID system has impulse response given by 


h{n} = (3)" 


a. 


b 


Cc 


d. 


Is the system causal? Justify your answer. 
. Compute =”, = — oo [A[n]]. Is this system BIBO stable? 


. Compute the energy and power of input signal x[n] = 3u[n — 5]. 


Using input x[n] = 3u[n — 5], determine the zero-state response of this system at time n = 10. That is, determine 


Yzs{10]. 


3.m.1 Consider the discrete-time function f[n] = e-"/Scos(ttn/5)uln]. MATLAB Session 3 uses an inline object in describing this function. 


>> £ = inline('exp(-n/5).* cos(pi*n/5).* (n>=0)','n'); 


While this inline object operates correctly for a downsampling operation such as £[2n], it does not operate correctly for an 


3.m.2 


3.m.3 


3.m.4 


3.m.5 


3.m.6 


3.m.7 


upsampling operation such as f [n/2]. Modify the inline object £ so that it also correctly accommodates upsampling operations. Test 
your code by computing and plotting f [n/2] over (—10 < n < 10). 


An indecisive student contemplates whether he should stay home or take his final exam, which is being held 2 miles away. Starting at 
home, the student travels half the distance to the exam location before changing his mind. The student turns around and travels half the 
distance between his current location and his home before changing his mind again. This process of changing direction and traveling 
half the remaining distance continues until the student either reaches a destination or dies from exhaustion. 


a. Determine a suitable difference equation description of this system. 


b. Use MATLAB to simulate the difference equation in part (a). Where does the student end up as n — oo? How do your 
answer change if the student goes two-thirds the way each time, rather than halfway? 


c. Determine a closed-form solution to the equation in part (a). Use this solution to verify the results in part (b). 
The cross-correlation function between x[n] and y[n] is given as 
~ 


rry[k] = pa x[n]y[n — k] 


a2 ce <) 
Notice that r,y[k] is quite similar to the convolution sum. The independent variable k corresponds to the relative shift between the two 
inputs. 

a. Express ryy[k] in terms of convolution. Is ryy[k] = ryy[k]? 

b. Cross-correlation is said to indicate similarity between two signals. Do you agree? Why or why not? 


c. If x[n] and y[n] are both finite duration, MATLAB's conv command is well suited to compute ryy[k]. 


i. Write a MATLAB function that computes the cross-correlation function using the conv command. Four 
vectors are passed to the function (x, y, nx, and ny) corresponding to the inputs x[n], y[n], and their 
respective time vectors. Notice that, x and y are not necessarily the same length. Two outputs should be 
created (rxy and k) corresponding to r,y[k] and its shift vector. 


ii. Test your code from part c(i), using x[n] = u[n — 5] — u[n — 10] over (O<n = ny < 20) and y[n] = u[—n — 
15] — u[—n — 10] + 8[n — 2] over (—20 < n= ny = 10). Plot the result rxy as a function of the shift vector 
k. What shift k gives the largest magnitude of r,y[k]? Does this make sense? 


A causal N-point max filter assigns y[n] to the maximum of {x[n],..., x[n — (N — 1)]}. 


a. Write a MATLAB function that performs N-point max filtering on a length-M input vector x. The two function inputs are 
vector x and scalar N. To create the length-M output vector Y, initially pad the input vector with N — 1 zeros. The 
MATLAB command max may be helpful. 


b. Test your filter and MATLAB code by filtering a length-45 input defined as x[n] = cos(trn/5) + 8[n — 30] — B[n — 35]. 
Separately plot the results for N = 4, N = 8, and N = 12. Comment on the filter behavior. 


A causal N-point min filter assigns y[n] to the minimum of {x{[n],..., x[n — (N — 1)]}. 


a. Write a MATLAB function that performs N-point min filtering on a length-M input vector x. The two function inputs are 
vector x and scalar N. To create the length-M output vector Y, initially pad the input vector with N — 1 zeros. The 
MATLAB command min may be helpful. 


b. Test your filter and MATLAB code by filtering a length-45 input defined as x[n] = cos(1tn/5) + 8[n — 30] — &[n — 35]. 
Separately plot the results for N = 4, N = 8, and N = 12. Comment on the filter behavior. 


A causal N-point median filter assigns y[n] to the median of {x[n],..., x[n — (N - 1)]}. The median is found by sorting sequence {x[n]...., 
x[n — (N — 1)]} and choosing the middle value (odd N) or the average of the two middle values (even N). 


a. Write a MATLAB function that performs N-point median filtering on a length-M input vector x. The two function inputs are 
vector x and scalar N. To create the length-M output vector Y, initially pad the input vector with N — 1 zeros. The 
MATLAB command sort or median may be helpful. 


b. Test your filter and MATLAB code by filtering a length-45 input defined as x[n] = cos(1tn/5) + 8[n — 30] — &[n — 35]. 
Separately plot the results for N = 4, N = 8, and N = 12. Comment on the filter behavior. 


Recall that y[n] = x[n/N] represents an up-sample by N operation. An interpolation filter replaces the inserted zeros with more realistic 
values. A linear interpolation filter has impulse response 


N-1 k 
h{n] = a: (1- =|) (0 —B) 


k=—-(N—-1) 


a. Determine a constant coefficient difference equation that has impulse response hA[n]. 


b. The impulse response h[n] is noncausal. What is the smallest time shift necessary to make the filter causal? What is the 


effect of this shift on the behavior of the filter? 


c. Write a MATLAB function that will compute the parameters necessary to implement an interpolation filter using 
MATLAB's £ilter command. That is, your function should output filter vectors b and a given an input scalar N. 


d. Test your filter and MATLAB code. To do this, create x[n] = cos(n) for (0 < n < 9). Upsample x[n] by N = 10 to create a 
new signal Xyp,[n]. Design the corresponding N = 10 linear interpolation filter, filter x,,)[n] to produce y[n], and plot the 
results. 


3.m.8 | A-causal N-point moving-average filter has impulse response A[n] = (u[n]—u[n—N])/N. 
a. Determine a constant coefficient difference equation that has impulse response hA[n]. 


b. Write a MATLAB function that will compute the parameters necessary to implement an N-point moving-average filter using 
MATLAB's £1 1ter command. That is, your function should output filter vectors b and a given a scalar input N. 


c. Test your filter and MATLAB code by filtering a length-45 input defined as x[n] = cos(trn/5) + 8[n — 30] — d[n — 35]. 
Separately plot the results for N = 4, N = 8, and N = 12. Comment on the filter behavior. 


d. Problem 3.M-7 introduces linear interpolation filters, for use following an up-sample by N operation. Within a scale factor, 
show that a cascade of two N—point moving-average filters is equivalent to the linear interpolation filter. What is the scale 
factor difference? Test this idea with MATLAB. Create x[n] = cos(n) for (0 < n < 9). Upsample x[n] by N = 10 to create a 
new signal Xyp[n]. Design an N = 10 moving-average filter. Filter x,,,[/n] twice and scale to produce y[n]. Plot the results. 


Does the output from the cascaded pair of moving-average filters linearly interpolate the upsampled data? 


Chapter 4: Continuous-Time System Analysis Using the Laplace Transform 


OVERVIEW 


Because of the linearity (superposition) property of linear time-invariant systems, we can find the response of these systems by breaking the input x(t) 
into several components and then summing the system response to all the components of x(t). We have already used this procedure in time-domain 
analysis, in which the input x(t) is broken into impulsive components. In the frequency-domain analysis developed in this chapter, we break up the 
input x(t) into exponentials of the form eS, where the parameter s is the complex frequency of the signal e! as explained in Section 1.4-3. This 
method offers an insight into the system behavior complementary to that seen in the time-domain analysis. In fact, the time-domain and the 
frequency-domain methods are duals of each other. 


The tool that makes it possible to represent arbitrary input x(t) in terms of exponential components is the Laplace transform, which is discussed in the 
following section. 


4.1 THE LAPLACE TRANSFORM 


For a signal x(t), its Laplace transform X(s) is defined by 


w 
X(s) - | x(ne dt (4.1) 
—oo 
The signal x(t) is said to be the inverse Laplace transform of X(s). It can be shown that!"] 
l c+ Joo 
x(t) = | X(s)e" ds (4,2) 
2H j Se-ieo 


where c is a constant chosen to ensure the convergence of the integral in Eq. (4.1), as explained later. 


This pair of equations is known as the bilateral Laplace transform pair, where X(s) is the direct Laplace transform of x(t) and x(t) is the inverse 
Laplace transform of X(s). Symbolically, 


X(s)=L[x(t)] and x(t) = L“"[X(s)] (4.3) 
Note that 
LNLION=x) and = L{L“"[X(s)]} = X(s) 
It is also common practice to use a bidirectional arrow to indicate a Laplace transform pair, as follows: 
x(t) ==> X(s) 
The Laplace transform, defined in this way, can handle signals existing over the entire time interval from — oo to co (causal and noncausal signals). 


For this reason it is called the bilateral (or two-sided) Laplace transform. Later we shall consider a special case-the unilateral or one-sided Laplace 
transform-which can handle only causal signals. 


LINEARITY OF THE LAPLACE TRANSFORM 
We now prove that the Laplace transform is a linear operator by showing that the principle of superposition holds, implying that if 
xi(t) <> Xi(s) and =. X2(t) <=> Xs) 


then 
x(t) —> Xi1(s) and x(t) => Xr(s) 


The proof is simple. By definition 


= 
L [a,x (t) + apx2(t)] = / (a,x, (t) + a2x2(N)Je~" dt 
) 


oO oO 
=a, [ x (ne dt + a [ x,(the~" dt 


= a) X\(5) + a, X25) (4.4) 
This result can be extended to any finite sum. 


THE REGION OF CONVERGENCE (ROC) 
The region of convergence (ROC), also called the region of existence, for the Laplace transform X(s), is the set of values of s (the region in the 
complex plane) for which the integral in Eq. (4.1) converges. This concept will become clear in the following example. 


EXAMPLE 4.1 
For a signal x(t) = e u(t), find the Laplace transform X(s) and its ROC. 
By definition 
co a) 
X(s) = if e “ute dt 


oo 


Because u(t) = 0 for t< 0 and u(t) = 1 for t = 0, 


x * 1 ™ 
X(s) - | e“e" dt = [ ee" d= eer (4.5) 
0 Jo S+a , 


Note that s is complex and as t — oo, the term e (Sta)t does not necessarily vanish. Here we recall that for a complex number z = « + jB, 
pnt e+ iB = et! o—jBt 


Now je /B| = 1 regardless of the value of Bt. Therefore, as t — 0, e-2! — 0 only if « > 0, and e” — if « <0. Thus 


, “ 0 Rez >0 (4.6) 
— o ore) Rez <0 - 
Clearly 
lim e-@*®™ = 0 Re(s +a) > 0 
100 ~ loo Re(s+a) <0 


Use of this result in Eq. (4.5) yields 
i 
X(s) = —— Re(s +a) > 0 (4.7a) 
S+a 
or 
al I 
eu) — —_ Res > —a (4.7b) 


S+a 


The ROC of X(s) is Re s > —a, as shown in the shaded area in Fig. 4.1a. This fact means that the integral defining X(s) in Eq. (4.5) exists only for 
the values of s in the shaded region in Fig. 4.1 a. For other values of s, the integral in Eq. (4.5) does not converge. For this reason the shaded 
region is called the ROC (or the region of existence) for X(s). 
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Figure 4.1: Signals (a) e ty (t) and (b) —ettu(—t) have the same Laplace transform but different regions of convergence. 


REGION OF CONVERGENCE FOR FINITE-DURATION SIGNALS 
A finite-duration signal x(t) is a signal that is nonzero only for t, < t < tg, where both t, and tg are finite numbers and fy > f,. For a finite-duration, 


absolutely integrable signal, the ROC is the entire s plane. This is clear from the fact that if x,(t) is absolutely integrable and a finite-duration signal, 
then x(t)e~° is also absolutely integrable for any value of o because the integration is over only finite range of t. Hence, the Laplace transform of 


such a signal converges for every value of s. This means that the ROC of a general signal x(t) remains unaffected by addition of any absolutely 
integrable, finite-duration signal x;(t) to x(t). In other words, if 72 represents the ROC of a signal x(t), then the ROC of a signal x(t) + x;(t) is also Fe. 


ROLE OF THE REGION OF CONVERGENCE 

The ROC is required for evaluating the inverse Laplace transform x(t) from X(s), as defined by Eq. (4.2). The operation of finding the inverse 
transform requires an integration in the complex plane, which needs some explanation. The path of integration is along c + jw, with w varying from 
—oo to colt] Moreover, the path of integration must lie in the ROC (or existence) for X(s). For the signal e ty (t), this is possible if c > —a. One 
possible path of integration is shown (dotted) in Fig. 4.1a. Thus, to obtain x(t) from X(s), the integration in Eq. (4.2) is performed along this path. 
When we integrate [1/(s + a)je* along this path, the result is e tu(t). Such integration in the complex plane requires a background in the theory of 
functions of complex variables. We can avoid this integration by compiling a table of Laplace transforms (Table 4.1), where the Laplace transform 
pairs are tabulated for a variety of signals. To find the inverse Laplace transform of, say, 1/(s + a), instead of using the complex integral of Eq. (4.2), 


we look up the table and find the inverse Laplace transform to be e ty(t) (assuming that the ROC is Re s > —a). Although the table given here is 
rather short, it comprises the functions of most practical interest. A more comprehensive table appears in Doetsch.!21 
Table 4.1: A Short Table of (Unilateral) Laplace Transforms 


= Open table as spreadsheet 
a | a | 


[No. || x(t) X(s) | 


2 u(t) 1 | 
s 
2 
a t"u(t) ld 
ss? 


5 |leMu(z) t 
s—2d 
6 teMu(t) l 
(s—A)? 
7 tertu(t) nl 
(s —A)r+! 
8a cos bt u(t) 5 
e+h 
8b sin bt u(t) b 
s? +b? 


9a || e-@ cos bt u(t) ——s 
(s +a) + 


9b |e @ sin bt u(t) : =e 
(s +a)? +b? 
10a || peat cog (bt + ®)u(t) (r cos @)s + (ar cos @ — br sin @) 
5? + 2as + (a? + Bb?) 
10b || re-at cos (bt + @)u(t) 0.5re?? 0.5re~/? 


r+u=]) Se 


10¢ || re~ cos (bt + 8)u(t) As +B 
s?+2ast+e 


bee | A?c + B? — 2ABa 
a c-a? 


— Aa —B 
7 A/c —a- 


b= Vc —a? 
a — ia As +B 
le” | Acos bt + sin bt] u(t) is? +2ast+e 


b= JVce—a* 


THE UNILATERAL LAPLACE TRANSFORM 


To understand the need for defining unilateral transform, let us find the Laplace transform of signal x(t) illustrated in Fig. 4.1b: 
x(t) = —e~u(—2) 
The Laplace transform of this signal is 


OO 


X(s) = —e" u(—tye~"' dt 


—00 


Because u(—t) = 1 for t< 0 and u(—t) = 0 for t> 0, 


0 0 
A(s)= f -—e"e"'dt= -{ ete dt = l en eraw 
= oo s+a e 


0 


Equation (4.6) shows that 
lim e“**=0 Re(s+a)<0 
too 


Hence 


X(s) = 


Res < —a 
S+a 


The signal —e~@u(—t) and its ROC (Re s < —a) are depicted in Fig. 4.1b. Note that the Laplace transforms for the signals e~ @u(t) and —e7 aty(—t) 
are identical except for their regions of convergence. Therefore, for a given X(s), there may be more than one inverse transform, depending on the 

ROC. In other words, unless the ROC is specified, there is no one-to-one correspondence between X(s) and x(t). This fact increases the complexity 
in using the Laplace transform. The complexity is the result of trying to handle causal as well as noncausal signals. If we restrict all our signals to the 


causal type, such an ambiguity does not arise. There is only one inverse transform of X(s) = 1/(s + a), namely, ety(t). To find x(t) from X(s), we 
need not even specify the ROC. In summary, if all signals are restricted to the causal type, then, for a given X(s), there is only one inverse transform 


x(t).[1] 
The unilateral Laplace transform is a special case of the bilateral Laplace transform in which all signals are restricted to being causal; consequently 


the limits of integration for the integral in Eq. (4.1) can be taken from 0 to oo. Therefore, the unilateral Laplace transform X(s) of a signal x(t) is 
defined as 


xO 

X(s) = | x(tje" dt (4.8) 
o- 

We choose 07 (rather than 0* used in some texts) as the lower limit of integration. This convention not only ensures inclusion of an impulse function 

at t = 0, but also allows us to use initial conditions at 0~ (rather than at 0*) in the solution of differential equations via the Laplace transform. In 

practice, we are likely to know the initial conditions before the input is applied (at 07), not after the input is applied (at 0*). Indeed, the very meaning 


of the term "initial conditions" implies conditions at t = 0” (conditions before the input is applied). Detailed analysis of desirability of using t = 07 
appears in Section 4.3. 


The unilateral Laplace transform simplifies the system analysis problem considerably because of its uniqueness property, which says that for a given 
X(s), there is a unique inverse transform. But there is a price for this simplification: we cannot analyze noncausal systems or use noncausal inputs. 

However, in most practical problems, this restriction is of little consequence. For this reason, we shall first consider the unilateral Laplace transform 

and its application to system analysis. (The bilateral Laplace transform is discussed later, in Section 4.11.) 


Basically there is no difference between the unilateral and the bilateral Laplace transform. The unilateral transform is the bilateral transform that deals 
with a subclass of signals starting at t = 0 (causal signals). Therefore, the expression [Eq. (4.2)] for the inverse Laplace transform remains 
unchanged. In practice, the term Laplace transform means the unilateral Laplace transform. 


EXISTENCE OF THE LAPLACE TRANSFORM 
The variable s in the Laplace transform is complex in general, and it can be expressed as s = o + jw. By definition 


X(s) = ' x(tje" dt 
J0- 


OO 


[x(ne "Je? dt 


6 


Because |e/”4| = 1, the integral on the right-hand side of this equation converges if 


)- 


- 
[ Ix(new"| dt< © (4.9) 


Hence the existence of the Laplace transform is guaranteed if the integral in expression (4.9) is finite for some value of o. Any signal that grows no 
faster than an exponential signal Me%! for some M and Oo Satisfies the condition (4.9). Thus, if for some M and oo, 


Ix(t)| < Me (4.10) 


2 
we can choose Oo > 09 to satisfy (4.9).[71] The signal et’, in contrast, grows at a rate faster than e°0! and consequently not Laplace transformable. [+] 
Fortunately such signals (which are not Laplace transformable) are of little consequence from either a practical or a theoretical viewpoint. If oo is the 
smallest value of o for which the integral in (4.9) is finite, Og is called the abscissa of convergence and the ROC of X(s) is Re s > Og. The abscissa 


of convergence for e y(t) is —a (the ROC is Re s > —a). 


EXAMPLE 4.2 
Determine the Laplace transform of the following: 


a. 8(f) 
b. u(t) 


c. cos w t u(t) 
oO 
£[8(t)] =| d(t)e"' dt 
a. o- 


Using the sampling property [Eq. (1.24a)], we obtain 
Lis(r)] = 1 for all s 
that is, 
jas for all s (4.11) 


b. To find the Laplace transform of u(t), recall that u(t) = 1 for t => 0. Therefore 


~ ~~ 1 ~ 
Luh] = [ u(the" dt - | e"“dt=--e" 
i v A — 


1 
at Res >0 (4.12) 
We also could have obtained this result from Eq. (4.7b) by letting a = 0. 


c. Because 


cos wot u(t) = Se + e~°”"Ju(r) 


(4.13) 
L [cos apt u(t)} = 4 Lfe u(t) + oF" u(t)] 
From Eq. (4.7), it follows that 
LI tu(t)] : : oa ; Re(s + jw) = Res > 0 
“ Do == =) @) = Ke > 
= : 2is— ja S$+ jw / . 
s 
= Res >0O (4.14) 


+a" 


For the unilateral Laplace transform, there is a unique inverse transform of X(s); consequently, there is no need to specify the ROC explicitly. For this 
reason, we shall generally ignore any mention of the ROC for unilateral transforms. Recall, also, that in the unilateral Laplace transform it is 
understood that every signal x(t) is zero for t < 0, and it is appropriate to indicate this fact by multiplying the signal by u(t). 


EXERCISE E4.1 


By direct integration, find the Laplace transform X(s) and the region of convergence of X (s) for the signals shown in Fig. 9 
4.2. as 


jain 


Figure 4.2 
Answers 

a. 
1 
-(l1-—e*) 
s for all s 

b. 
I eee 
-(l-e ~)e 

for all s 


4.1-1 Finding the Inverse Transform 


Finding the inverse Laplace transform by using the Eq. (4.2) requires integration in the complex plane, a subject beyond the scope of this book (but 
see, e.g., Ref. 3). For our purpose, we can find the inverse transforms from the transform table (Table 4.1). All we need is to express X(s) as a sum 
of simpler functions of the forms listed in the table. Most of the transforms X(s) of practical interest are rational functions, that is, ratios of polynomials 
in s. Such functions can be expressed as a sum of simpler functions by using partial fraction expansion (see Section B.5). 


Values of s for which X(s) = 0 are called the zeros of X(s); the values of s for which X(s) — © are called the poles of X(s). If X(s) is a rational 
function of the form P(s)/Q(s), the roots of P(s) are the zeros and the roots of Q(s) are the poles of X(s). 


EXAMPLE 4.3 _ ; 
Find the inverse Laplace transforms of 


a. 


7s —6 
s?—s —6 


2s? +5 
s27+354+2 


6(s + 34) 
s(s? + 10s + 34) 


8s + 10 
(s + 1)(s + 2)3 


In no case is the inverse transform of these functions directly available in Table 4.1. Rather, we need to expand these functions into partial fractions, 
as discussed in Section B.5-1. In this computer age, it is very easy to find partial fractions on a computers. However, just as the availability of a 
handheld computer does not obviate the need for learning the mechanics of arithmetical operations (addition, multiplication, etc.), the widespread 
availability of computers does not eliminate the need to learn the mechanics of partial fraction expansion. 


7s —6 
X(s) = —————————_ 
ts) (s + 2)(s — 3) 
= ky ky 
a. F422" s-3 


To determine k;, corresponding to the term (s + 2), we cover up (conceal) the term (s + 2) in X(s) and substitute s = —2 (the value of s 
that makes s + 2 = 0) in the remaining expression (see Section B.5-2): 


7s —6 —14-—6 


i= = =4 
(RBs -3) 


s=-2 —2 saa 3 


Similarly, to determine kz corresponding to the term (s — 3), we cover up the term (s — 3) in X(s) and substitute s = 3 in the remaining 


expression 
— 7s —6 ee oe 3 
> (6+2 ME.» 342 °° 
Therefore 
Ts —6 4 3 
X(s) = —— + (4.15) 


(s +2)(s — 3) - s+2 s-3 
CHECKING THE ANSWER 


It is easy to make a mistake in partial fraction computations. Fortunately it is simple to check the answer by recognizing that X(s) and its 
partial fractions must be equal for every value of s if the partial fractions are correct. Let us verify this assertion in Eq. (4.15a) for some 
convenient value, say s = 0. Substitution of s = 0 in Eq. (4.15a) yields!T] 


b=? =—1 1 


We can now be sure of our answer with a high margin of confidence. Using pair 5 of Table 4.1 in Eq. (4.15a), we obtain 


4 3 Pp 
x()=L! (= + a = (4e-* + 3e" u(t) (4.15b) 
$+2 s-3 
b. 
2s? +5 2s7 +5 
X(s) = 


2 +3s+2 (st+ly(s+2) 


Observe that X(s) is an improper function with M = N. In such a case we can express X(s) as a sum of the coefficient of the highest 
power in the numerator plus partial fractions corresponding to the poles of X(s) (see Section B.5-5). In the present case the coefficient 
of the highest power in the numerator is 2. Therefore 


ki 
X(s) =2+— 


ya 


Fel 742 


where 


= 2" +5 | _2+5 _, 
HG +1. -14+2- 
and 
2s? +5 8+5 
b=—— |= ==13 
(s+ 1)... 9-2 +1 
Therefore 7 
X 24+—-— 
a | s+1 s+2 
From Table 4.1, pairs 1 and 5, we obtain 
x(t) = 28(t) + (Te — 13e-™ u(t) (4.16) 


6(s + 34) 


=") = s(s? + 10s + 34) 


_ 6(s + 34) 

~ s(s +5 — j3)(s +5 + f3) 

_ kh ky ky 
ma "$ps= 0 s454+95 


Note that the coefficients (kp and k*2) of the conjugate terms must also be conjugate (see Section B.5). Now 


6(s + 34) _ 6 x 34 6 
1 Hs? + 105+34)|0 34 
_ 29 
6(s + 34) | ur Le 
~ SMOG +5473) )--su 3-55 
Therefore 
k= -3-j4 


To use pair 10b of Table 4.1, we need to express ky and k*> in polar form. 
—3+ j4= (V3? +4) eftn'4/-3) _ 5 pj tan 14/3) 


Observe that tan71(4/—3) # tan71(—4/3). This fact is evident in Fig. 4.3. For further discussion of this topic, see Example B.1. 


3+ j4 Qe 


Figure 4.3: tan™! (—4/3) + tan”! (4/3). 


From Fig. 4.3, we observe that 
° io 

kp = —3 + j4 = 5e/!769 

so that 

ki = 5e7 1126.9" 


Therefore 


6 5ei126. 5e7 i126." 
MOS T5533 84a 
From Table 4.1 (pairs 2 and 10b), we obtain 
x(t) =[6 + 10e~* cos (31 + 126.9°)]u(r) (4.17) 
ALTERNATIVE METHOD USING QUADRATIC FACTORS 


The foregoing procedure involves considerable manipulation of complex numbers. Pair 10c (Table 4.1) indicates that the inverse 
transform of quadratic terms (with complex conjugate poles) can be found directly without having to find first-order partial fractions. We 
discussed such a procedure in Section B.5-2. For this purpose, we shall express X(s) as 


X(s) = 6(s + 34) _ ky 4. As +B 
~ s(s?+10s+34) 5s  s?+10s +34 


We have already determined that k,; = 6 by the (Heaviside) "cover-up" method. Therefore 


6(s + 34) 6 As+B 


fe Ss, x OS ee 
s(s?+105+34) 5s s?+105s+34 


Clearing the fractions by multiplying both sides by s(s? + 10s + 34) yields 
, 

6(s +34) = (6+ A)s* + (60 + B)s + 204 

Now, equating the coefficients of s? and s on both sides yields 

A=-6 and B= —54 


and 


X(s) 6 mi —6s — 54 
j=- ————— 
' g§ s?+10s +34 
We now use pairs 2 and 10c to find the inverse Laplace transform. The parameters for pair 10c are A = —6, B= —54, a= 5, c —34, b= 
Jc — a* = 3, and 
| A2e B? —2ABa Aa—B 
r= i ate - = 10 @ = tan! ———— _ = 126.9" 
ome AJ/c-—a 
Therefore 
x(t) = [6 + 10e-* cos (3¢ + 126.9°) u(t) 
which agrees with the earlier result. 


SHORTCUTS 


The partial fractions with quadratic terms also can be obtained by using shortcuts. We have 


xis) = —OS+34) __ 6 AS +B 
~ s(s?+10s+34) s | s?+10s +34 


We can determine A by eliminating B on the right-hand side. This step can be accomplished by multiplying both sides of the equation 
for X(s) by s and then letting s — oo. This procedure yields 
0=6+A = A=-6 


Therefore 
6(s + 34) 6 i —6s + B 
s(s?+10s+34) s s*+10s+34 


To find B, we let s take on any convenient value, say s = 1, in this equation to obtain 


210 B-6 
— =6 B=—-54 
so 8 as 
a result that agrees with the answer found earlier. 
8s +1 
(s + 1)(s + 2)3 
ky ao ay a 


341 G42) G42 542 


where 


— 8s +10 = 
‘Ks + 2)°1,_, 
P 8s + 10 6 
= = 
(s + 1) GBF |.--2 
‘ d 8s +10 > 
l= ooo =— 
ds |(s+ 1) |) 
null# 85 +10 _-% 
~ 2 (40 |s+ 1). 
Therefore 
X(s) 2 + § Z : 
ie ag (s+2)3 (s+2)? 542 
and 


x(t) = [2e7' + Bf — 21 —2)e7™ Jus) (4.18) 
ALTERNATIVE METHOD: A HYBRID OF HEAVISIDE AND CLEARING FRACTIONS 


In this method, the simpler coefficients k; and ag are determined by the Heaviside "cover-up" procedure, as discussed earlier. To 
determine the remaining coefficients, we use the clearing-fraction method. Using the values k; = 2 and ao = 6 obtained earlier by the 
Heaviside "cover-up" method, we have 


8s + 10 2 6 ay a 


———— = —— + — 7 + SS + 
(st+1hist+2P st+l1 (s+2)) (+2)? s+2 
We now clear fractions by multiplying both sides of the equation by (s + 1)(s + 28], This procedure yields!T] 
Bs + 10 = 2(s +2)? + G(s + 1) + ay(s + IMs +2) tals + Ls +27 
= (2 +as)s* + (12 + a + Sas)s? + (30 + 3a + 8as)s + (22 + 2a: + 4a) 

Equating coefficients of s® and s? on both sides, we obtain 
0=(2+a,) => Q=-2 
O=12+a+5H=2+a => a=-2 
We can stop here if we wish, since the two desired coefficients a, and az have already been found. However, equating the coefficients 
of s' and s° serves as a check on our answers. This step yields 

8 = 30+ 3a, + 8a2 
10 = 22 + 2a; + 4a 


Substitution of a; = az = —2, obtained earlier, satisfies these equations. This step assures the correctness of our answers. 
ANOTHER ALTERNATIVE: A HYBRID OF HEAVISIDE AND SHORTCUTS 


In this method, the simpler coefficients k; and ag are determined by the Heaviside "cover-up" procedure, as discussed earlier. The 
usual shortcuts are then used to determine the remaining coefficients. Using the values k, = 2 and ao = 6, determined earlier by the 
Heaviside method, we have 


8s + 10 2 4 6 ‘ ay 2 ay 
(s+1)\(s+2)3 s+1 (s+2 (s+2)? 5+2 
There are two unknowns, a, and az. If we multiply both sides by s and then let s — oo, we elminate a;. This procedure yields 
0=2+m@ = &=-2 


Therefore 
8s + 10 2 + 6 + ay 2 
(s+1)(s+2)> s+1  (s+2)? (s+2)? 5+2 
There is now only one unknown, a1. This value can be determined readily by setting s equal to any convenient value, say s = 0. This 
step yields 


8 TR" % 


COMPUTER EXAMPLE C4.1 


Using the MATLAB residue command, determine the inverse Laplace transform of each of the following functions: 


a. 
257 +5 
Ei)" Saad 
s?+35+2 
b. 
2s? +75+4 
X(9) = ————— 
(s+ 1)(s +2) 
Cc. 
x. 8s? + 215 + 19 
$;) = 
. (s +2)(s? +5 +7) 
>> num = [2 0 5]; den = [1 3 2]; 
>> [xr, p, k] = residue (num, den); 
>> disp([{ '(a) r = [ ',num2str(r. ', ' %0.5g '), '"] 'J); 
>> disp([ * p= [| *,num2strip. ', * S0.5q %), TT "10 ee. 
>> disp([ ' k = [ ',num2str(k. ', ' %0.5g '), '] ']); 
fay 2 = [=13 7] 
p [-2 -1] 
k = [2] 


Therefore, Xq(s) = —13/(s + 2) + 7s + 1)+2 and x,(t) = (—13e72! +7e7t)u(t)+28(1). 


>> num = [2 7 4]; den = [conv([1 1],conv([1 2], [1 2])]); 
>> [xr, p, k] = residue (num,den); 

>> disp([. *(b) r = [ ',num2str(r. *, ' 30.59 "), "J "))? 
>> disp([ ' p = [ ',num2str(p. ', ' 30.59 '), '] 'J)F.. 
>> disp({ * k = [ *,;num@stri(k. '; * 025g "), TY) "))4 

(b) vr = [3 2 -1] 


>> num = [8 21 19]; den = [conv([1 2], ([{1 1 7])]; 
>> [xr, p, k] = residue (num, den); 
>> disp([ "(c) r = [ ',num2str(r. ', " %0.5g "), "J "])e. 
>> disp([ ' p = [ ',num2str(p. ', ' %$0.5g '), '"] 'J);... 
>> disp([ " k= [ ',;num@str(k. ', * 0.5g¢ "), "J "I)e... 
>> disp([{ ' rad = [ ',num2str(rad. ', ' 30.59 '), '] ']); 
>> disp([ ' mag = [ ',num2str(mag. ', ' %0.5g '), "J 'J); 
(c) v = [3.5-0.481131i 3.5+0.481131i 1+0i1] 
p [-0.54+2.59811 -0.5-2.598117 -2+01] 
k = [J 
rad = [-0.13661 0.13661 0] 
mag = [3.5329 3.5329 1] 
Thus, 
(5) me bg SSBB 3.5329 eMNII60 

S4+2  s+0.5— 2.5981 © 5+0.5+ j2.5981 
and 


x(t) = [e~™ + 1.7665e~°* cos(2.59811 — 0.1366) ]u(r). 


COMPUTER EXAMPLE C4.2 


Using MATLAB 's symbolic math toolbox, determine the following: 


a. the direct Laplace transform of x(t) = sin (at) + cos (bf) 


b. the inverse Laplace transform of Xp(s) = as2/(s? + b2) 


kkk 


Therefore, X, = (s° + as? + a2s + b2a)/(s? + a2)(s2 + b2) 


kkk 


Therefore, xp(t) = a5(t) — ab sin (bt)u(t). 


EXERCISE E4.2 


i. Show that the Laplace transform of 10e~*! cos (4t + 53.13°) is (6s — 14)/ (s* + 6s + 25). Use pair 10a ? 
from Table 4.1. 


ii. Find the inverse Laplace transform of the following: 
s+17 
a. S?7+4s—5 
3s —5 
b. (§ + 1)(s? + 254 5) 


l6s + 43 
c. (§ —2){s + 3)? 


Answers 


a. (3e! — 2e **)u(t) 


b. 
[—2e~! + $e~' cos (2t — 36.87°)] u(t) 


c. [3e2! + (t — 3)eS4 Just) 


A HISTORICAL NOTE: 
MARQUIS PIERRE-SIMON DE LAPLACE (1749-1827) 


The Laplace transform is named after the great French mathematician and astronomer Laplace, who first presented the transform and its applications 
to differential equations in a paper published in 1779. 


Pienre-Simon de Laplace Oliver Heaviside 


Pierre-Simon de Laplace 


Laplace developed the foundations of potential theory and made important contributions to special functions, probability theory, astronomy, and 
celestial mechanics. In his Exposition du systéme du monde (1796), Laplace formulated a nebular hypothesis of cosmic origin and tried to explain the 
universe as a pure mechanism. In his Traité de mécanique céleste (celestial mechanics), which completed the work of Newton, Laplace used 
mathematics and physics to subject the solar system and all heavenly bodies to the laws of motion and the principle of gravitation. Newton had been 
unable to explain the irregularities of some heavenly bodies; in desperation, he concluded that God himself must intervene now and then to prevent 
such catastrophes as Jupiter eventually falling into the sun (and the moon into the earth) as predicted by Newton 's calculations. Laplace proposed to 
show that these irregularities would correct themselves periodically and that a little patience -in Jupiter 's case, 929 years -would see everything 
returning automatically to order; thus there was no reason why the solar and the stellar systems could not continue to operate by the laws of Newton 


and Laplace to the end of time.!4] 


Laplace presented a copy of Mécanique céleste to Napoleon, who, after reading the book, took Laplace to task for not including God in his scheme: 
"You have written this huge book on the system of the world without once mentioning the author of the universe.” "Sire," Laplace retorted, "| had no 
need of that hypothesis." Napoleon was not amused, and when he reported this reply to another great mathematician-astronomer, Louis de 


Lagrange, the latter remarked, "Ah, but that is a fine hypothesis. It explains so many things."[5] 


Napoleon, following his policy of honoring and promoting scientists, made Laplace the minister of the interior. To Napoleon 's dismay, however, the 
new appointee attempted to bring "the spirit of infinitesimals" into administration, and so Laplace was transferred hastily to the senate. 


OLIVER HEAVISIDE (1850-1925) 


Although Laplace published his transform method to solve differential equations in 1779, the method did not catch on until a century later. It was 


rediscovered independently in a rather awkward form by an eccentric British engineer, Oliver Heaviside (1850-1925), one of the tragic figures in the 
history of science and engineering. Despite his prolific contributions to electrical engineering, he was severely criticized during his lifetime and was 
neglected later to the point that hardly a textbook today mentions his name or credits him with contributions. Nevertheless, his studies had a major 
impact on many aspects of modern electrical engineering. It was Heaviside who made transatlantic communication possible by inventing cable 
loading, but no one ever mentions him as a pioneer or an innovator in telephony. It was Heaviside who suggested the use of inductive cable loading, 


but the credit is given to M. Pupin, who was not even responsible for building the first loading coil.[T] In addition, Heaviside was!®] 
» The first to find a solution to the distortionless transmission line. 
= The innovator of lowpass filters. 
= The first to write Maxwell 's equations in modern form. 
= The codiscoverer of rate energy transfer by an electromagnetic field. 


» An early champion of the now-common phasor analysis. 


» An important contributor to the development of vector analysis. In fact, he essentially created the subject independently of Gibbs.!7] 


» An originator of the use of operational mathematics used to solve linear integro-differential equations, which eventually led to 
rediscovery of the ignored Laplace transform. 


= The first to theorize (along with Kennelly of Harvard) that a conducting layer (the Kennelly-Heaviside layer) of atmosphere exists, which 
allows radio waves to follow earth 's curvature instead of traveling off into space in a straight line. 


= The first to posit that an electrical charge would increase in mass as its velocity increases, an anticipation of an aspect of Einstein 's 
special theory of relativity.[8] He also forecast the possibility of superconductivity. 


Heaviside was a self-made, self-educated man. Although his formal education ended with elementary school, he eventually became a pragmatically 
successful mathematical physicist. He began his career as a telegrapher, but increasing deafness forced him to retire at the age of 24. He then 
devoted himself to the study of electricity. His creative work was disdained by many professional mathematicians because of his lack of formal 
education and his unorthodox methods. 


Heaviside had the misfortune to be criticized both by mathematicians, who faulted him for lack of rigor, and by men of practice, who faulted him for 
using too much mathematics and thereby confusing students. Many mathematicians, trying to find solutions to the distortionless transmission line, 
failed because no rigorous tools were available at the time. Heaviside succeeded because he used mathematics not with rigor, but with insight and 
intuition. Using his much maligned operational method, Heaviside successfully attacked problems that the rigid mathematicians could not solve, 
problems such as the flow of heat in a body of spatially varying conductivity. Heaviside brilliantly used this method in 1895 to demonstrate a fatal 
flaw in Lord Kelvin 's determination of the geological age of the earth by secular cooling; he used the same flow of heat theory as for his cable 
analysis. Yet the mathematicians of the Royal Society remained unmoved and were not the least impressed by the fact that Heaviside had found the 
answer to problems no one else could solve. Many mathematicians who examined his work dismissed it with contempt, asserting that his methods 


were either complete nonsense or a rehash of known ideas. [6] 


Sir William Preece, the chief engineer of the British Post Office, a savage critic of Heaviside, ridiculed Heaviside 's work as too theoretical and, 
therefore, leading to faulty conclusions. Heaviside 's work on transmission lines and loading was dismissed by the British Post Office and might have 


remained hidden, had not Lord Kelvin himself publicly expressed admiration for it.[61 


Heaviside 's operational calculus may be formally inaccurate, but in fact it anticipated the operational methods developed in more recent years.!9] 
Although his method was not fully understood, it provided correct results. When Heaviside was attacked for the vague meaning of his operational 
calculus, his pragmatic reply was, "Shall | refuse my dinner because | do not fully understand the process of digestion?" 


Heaviside lived as a bachelor hermit, often in near-squalid conditions, and died largely unnoticed, in poverty. His life demonstrates the persistent 
arrogance and snobbishness of the intellectual establishment, which does not respect creativity unless it is presented in the strict language of the 
establishment. 

[]Lathi, B. P. Signal Processing and Linear Systems, 1st ed. Oxford University Press, New York, 1998. 


[tlThe discussion about the path of convergence is rather complicated, requiring the concepts of contour integration and understanding of the theory 
of complex variables. For this reason, the discussion here is somewhat simplified. 


[2]Doetsch, G. Introduction to the Theory and Applications of the Laplace Transformation with a Table of Laplace Transformations. Springer-Verlag, 
New York, 1974. 


[tlActually, X(s) specifies x(t), within a null function n(t), which has the property that the area under [n(t)|? is Zero over any finite interval 0 to t (t > 
0) (Lerch 's theorem). For example, if two functions are identical everywhere except at finite number of points, they differ by a null function. 


[tlCondition (4.10) is sufficient but not necessary for the existence of the Laplace transform. For example x(t) = 1/,/t is infinite at t= 0 and, (4.10) 
cannot be satisfied, but the transform of 1/,/t exists and is given by /TI/s. 


[+] However, if we consider a truncated (finite duration) signal e!”, the Laplace transform exists. 


[tlBecause X(s) = co at its poles, we should avoid the pole values (—2 and 3 in the present case) for checking. The answers may check even if 


partial fractions are wrong. This situation can occur when two or more errors cancel their effects. But the chances of this problem arising for randomly 
selected values of s are extremely small. 


[3]_ePage, W. R. Complex Variables and the Laplace Transforms for Engineers. McGraw-Hill, New York, 1961. 


[tlWe could have cleared fractions without finding ky and ag. This alternative, however, proves more laborious because it increases the number of 
unknowns to 4. By predetermining k; and ag, we reduce the unknowns to 2. Moreover, this method provides a convenient check on the solution. This 
hybrid procedure achieves. the best of both methods. 


[4]Durant, Will, and Ariel Durant. The Age of Napoleon, Part XI in The Story of Civili ation Series. Simon & Schuster, New York, 1975. 
[S]Bell, E. T. Men of Mathematics. Simon & Schuster, New York, 1937. 


[tlHeaviside developed the theory for cable loading, George Campbell built the first loading coil, and the telephone circuits using Campbell 's coils 
were in operation before Pupin published his paper. In the legal fight over the patent, however, Pupin won the battle because of his shrewd self- 
promotion and the poor legal support for Campbell. 


[6]Nahin, P. J. "Oliver Heaviside: Genius and Curmudgeon." IEEE Spectrum, vol. 20, pp. 63 -69, July 1983. 
I7]Berkey, D. Calculus, 2nd ed. Saunders, Philadelphia, 1988. 
[8]Encyclopaedia Britannica. Micropaedia IV, 15th ed., p. 981, Chicago, 1982. 


[9]Churchill, R. V. Operational Mathematics, 2nd ed. McGraw-Hill, New York, 1958. 


4.2 SOME PROPERTIES OF THE LAPLACE TRANSFORM 


Properties of the Laplace transform are useful not only in the derivation of the Laplace transform of functions but also in the solutions of linear 
integro-differential equations. A glance at Eqs. (4.2) and (4.1) shows that there is a certain measure of symmetry in going from x(t) to X(s), and vice 
versa. This symmetry or duality is also carried over to the properties of the Laplace transform. This fact will be evident in the following development. 


We are already familiar with two properties; linearity [Eq. (4.4)] and the uniqueness property of the Laplace transform discussed earlier. 


4.2-1 Time Shifting 


The time-shifting property states that if 
x(t) <=> X(s) 
then for tg => 0 
x(t — bo) <=> X(s)e (4.19a) 


Observe that x(t) starts at t= 0, and, therefore, x(t — fo) starts at t = tg. This fact is implicit, but is not explicitly indicated in Eq. (4.19a). This often 
leads to inadvertent errors. To avoid such a pitfall, we should restate the property as follows. If 


x(u(t) = > X(s) 
then 
X(t — foul — by) — > Xi(s)e™ flo = 0 (4.19b) 


Proof. 


oO 
L£[x(t — uti — ty) | = | X(t —f)u(t — fo)e* dt 


Setting t — to = T, we obtain 
oO 


Li[x(t — t)u(t — w&)] = | x(t)u(r)e “"'™ dr 


fo 


Because u(t) = 0 for T < 0 and u(t) = 1 for tT = O, the limits of integration can be taken from 0 to oo. Thus 


oo 
L£[x(t — f)ult — t)] =| x(z)e*" + dr 
Oo 


meme f x(t)e "dt 
0 


=X(s)e 
Note that x(t — to)u(t — tg) is the signal x(t)u(t) delayed by to seconds. The time-shifting property states that delaying a signal by tg seconds 


amounts to multiplying its transform e7 Sto, 


This property of the unilateral Laplace transform holds only for positive tg because if fo were negative, the signal x(t — tg)u(t — tg) may not be 
causal. 


We can readily verify this property in Exercise E4.1. If the signal in Fig. 4.2a is x(t)u(t), then the signal in Fig. 4.2b is x(t — 2)u(t — 2). The Laplace 


transform for the pulse in Fig. 4.2a is (1/s)(1 — @”75), Therefore, the Laplace transform for the pulse in Fig. 4.2b is (1/s)(1 — e2S)e2s5, 


The time-shifting property proves very convenient in finding the Laplace transform of functions with different descriptions over different intervals, as 
the following example demonstrates. 


EXAMPLE 4.4 _ 
Find the Laplace transform of x(t) depicted in Fig. 4.4a. 


af a() rf 


Figure 4.4: Finding a mathematical description of a function x(t). 


Describing mathematically a function such as the one in Fig. 4.4a is discussed in Section 1.4. The function x(t) in Fig. 4.4a can be described as a 
sum of two components shown in Fig. 4.4b. The equation for the first component is t — 1 over 1 < t < 2, so that this component can be described 
by (t — 1)[u(t — 1) — u(t — 2)]. The second component can be described by u(t — 2) — u(t — 4). Therefore 


x(t) = (¢ — D[u(t — 1) — u(t — 2)] + [u(t — 2) — u(t — 4)] 
= (tf — Iu(t — 1) — t — Dut — 2) + a(t — 2) — ur — 4) (4.20a) 
The first term on the right-hand side is the signal tu(t) delayed by 1 second. Also, the third and fourth terms are the signal u(t) delayed by 2 and 4 
seconds, respectively. The second term, however, cannot be interpreted as a delayed version of any entry in Table 4.1. For this reason, we 


rearrange it as 
(¢— Iu(t —2) = (( —2 + Dut — 2) = (¢ — 2)u(t — 2) + u(t — 2) 


We have now expressed the second term in the desired form as tu(t) delayed by 2 seconds plus u(t) delayed by 2 seconds. With this result, Eq. 
(4.20a) can be expressed as 
x(t) = (t — Dutt — 1) — (t — 2)u(t — 2) — u(t — 4) (4.20b) 


Application of the time-shifting property to tu(t) <=> 1/s? yields 


(¢ — lu(t — 1) — —e™ ands (t — 2)u(t —2) => —e * 
= 2 


Also 
I —4s 
u(t -—4) <=> ri (4.21) 


Therefore 


l . | 
X(s)= we ‘¥_—@* — =—¢ ™ (4.22) 


EXAMPLE 4.5 
Find the inverse Laplace transform of 


s+3+5e% 


Bite ee 
) = Ge petD 


Observe the exponential term e725 in the numerator of X(s), indicating time delay. In such a case we should separate X(s) into terms with and 
without delay factor, as 


xis) 5+3 “ 5e-* 
Ss) = —_ ——$—$——$ 
(s+1)(s+2) (s+1)(s+2) 
ee 
Xi(s) X2(sje~*s 
where . ; ; 
S+: 
(s+1)(s+2) st+1 5s+2 
by 5 5 
Xx(s) = ———qye = — -—— 


Therefore 
xy(t) = (2e7* — e~™ u(t) 
x(t) = 5(e* —e u(t) 


Also, because 


X(s) = Xi(s) + X2(s)e™ 


We can write 


x(t) = x,(t) + x:(t — 2) 
as (2e"' = en" )u(t) aol [e~o- = e7-3] u(t — 2) 


EXERCISE E4.3 


Find the Laplace transform of the signal illustrated in Fig. 4.5. 9) 


x(t) ° 


0 1 
Figure 4.5 


NM 
es) 
~ 


Answers 


Aa — 3e°* + 2¢°*) 
Py 


EXERCISE E4.4 


Find the inverse Laplace transform of 9 


3¢e-2 ° 
a 
()= G—petD 


Answers 


[ef-2 _ e A(t 2) y(t— 2) 


4.2-2 Frequency Shifting 


The frequency-shifting property states that if 
x(t) => X(s) 


then 
x(ne™ <> X(s — 50) (4.23) 
Observe the symmetry (or duality) between this property and the time-shifting property (4.19a). 


Proof. 
x o> 
L[x(pe™] =| x(ne™e" dt = | x(t)e"F-™ dr = X(s — So) 
0 0 
EXAMPLE 4.6 
Derive pair 9a in Table 4.1 from pair 8a and the frequency-shifting property. 


Pair 8a is 


btu(t) > —— 
cos bt u(t) 4h 


From the frequency-shifting property [Eq. (4.23)] with so = —a we obtain 
S+a 


et but) > ——_— 
cos bit u(t) Gral+e 


EXERCISE E4.5 
Derive pair 6 in Table 4.1 from pair 3 and the frequency-shifting property. 


We are now ready to consider the two of the most important properties of the Laplace transform: time differentiation and time integration. 


4.2-3 The Time-Differentiation Property!T! 


The time-differentiation property states that if 
x(t) <=> X(s) 
then 


= <> sX{(s)—x(0 ) (4.24a) 


Repeated application of this property yields 


d’x 
ae 
d"x 
am 


<= s?X(s) — sx(0") — X(07) (4.24b) 


<> s"X(s) —s""'x(0-) — 5" 707) — --- — xX 9) 


a 
= s"X(s)- pe nae (4.24¢) 


tal 


where x‘)(0-) is a” x/dt" at t= 07. 


Proof. 
dx aia © 
Li—|= —e"dt 
= 0 dt. 


Integrating by parts, we obtain 


a ee OD 
L = = x(r)e" |) +f x(tje"' dt 
dt 0 


For the Laplace integral to converge [i.e., for X (s) to exist], it is necessary that x(t)e St — 0 ast-— oo for the values of s in the ROC for X(s). Thus, 


G B = —x(0") + sX(s) 
dt 


Repeated application of this procedure yields Eq. (4.24c). 


EXAMPLE 4.7 


Find the Laplace transform of the signal x(t) in Fig. 4.6a by using Table 4.1 and the time-differentiation and time-shifting properties of the Laplace 
transform. 


(a) 


(c) 
Figure 4.6: Finding the Laplace transform of a piecewise-linear function by using the time-differentiation property. 


Figures 4.6b and 4.6c show the first two derivatives of x(t). Recall that the derivative at a point of jump discontinuity is an impulse of strength equal 
to the amount of jump [see Eq. (1.27)]. Therefore 
d*x 
—— = 8(t) — 35(t — 2) + 28(t — 3) 
dt 
The Laplace transform of this equation yields 
. (ax nu 
F a (= = L[d(t) -— 3d(t —2) +28 -— 3)] 
Using the time-differentiation property Eq. (4.24b), the time-shifting property (4.19a), and the facts that 5(1) — 1 and 8(t) <=> 1, we obtain 
on - 
s°X(s) -0-O0=1-3e* + 2e* 
Therefore 


i 
X(s) = S(1—3e + 2e-*) 


which confirms the earlier result in Exercise E4.3. 


4.2-4 The Time-Integration Property 


The time-integration property states that if 
x(t) ==> X(s) 


then!T] 


i 
Xx 
ri x(t)dt = os (4.25) 
0 


X(s) f° .x(r)dt 
———— 


if 
/ x(t)dt —> (4.26) 


Proof. We define 


f 
a) = | x(t)dt 
0 


so that 


d 
qe) = #0) and g(0 )=0 


Now, if - 
g(t) = > G(s) 
then 
d 
X()=L Za0n| = sG(s) — g(0°) = sG(s) 
Therefore 
Xs 
G(s) = ‘s) 
S 
ae 
X 
| x(t)dt => = 
0o- A 


To prove Eq. (4.26), observe that 


1 o- 1 
if x(t)dt =| x(t)dt +/ x(t)dt 
no oo o- 


Note that the first term on the right-hand side is a constant for t > 0. Taking the Laplace transform of the foregoing equation and using Eq. (4.25), 


we obtain 
t 0 
x({t)dt X 
if x(t) dr qexp Lee) EF a 
—n0 Ss d 


Scaling 
The scaling property states that if 
x(t) ==> X{(s) 
then for a > 0 
1... /§ 
x(at) <=> -Fi- (4.27) 
a a 
The proof is given in Chapter 7. Note that a is restricted to positive values because if x(t) is causal, then x(at) is anticausal (is zero for t => 0) for 


negative a, and anticausal signals are not permitted in the (unilateral) Laplace transform. 


A 
Recall that x(at) is the signal x(t) time-compressed by the factor a, and x (7) is X(s) expanded along the s-scale by the same factor a (see Section 
1.2-2). The scaling property states that time compression of a signal by a factor a causes expansion of its Laplace transform in the s-scale by the 
same factor. Similarly, time expansion x(t) causes compression of X(s) in the s-scale by the same factor. 


4.2-5 Time Convolution and Frequency Convolution 


Another pair of properties states that if — a 
xi(t) — > Xi(s) and X2(t) <> X2(s) 


then (time-convolution property) 
Xi (f) *x2(1) <—> Xi (5s) X2(s) (4.28) 
and (frequency-convolution property) 


=— 1X1 (s) * X2(s)] (4.29) 
2xj 


X1(Ox2t) — 


Observe the symmetry (or duality) between the two properties. Proofs of these properties are postponed to Chapter 7. 
Equation (2.48) indicates that H(s), the transfer function of an LTIC system, is the Laplace transform of the system's impulse response h(t); that is, 
h(t) <> H(s) (4.30) 


If the system is causal, h(t) is causal, and, according to Eq. (2.48), H(s) is the unilateral Laplace transform of h(t). Similarly, if the system is 
noncausal, h(t) is noncausal, and H(s) is the bilateral transform of h(t). 


We can apply the time-convolution property to the LTIC input-output relationship y(t) = x(t) * h(t) to obtain 
Y(s) = X(s)H(s) (4.31) 
The response y(t) is the zero-state response of the LTIC system to the input x(t). From Eq. (4.31), it follows that 


Y(s) 
H(s)=— = 
=X 


L{zero-state response] 
L{input} 


This may be considered to be an alternate definition of the LTIC system transfer function H(s). It is the ratio of the transform of zero-state response 


to the transform of the input. 


EXAMPLE 4.8 


(4.32) 


Using the time-convolution property of the Laplace transform to determine c(t) = e# 


From Eq. (4.28), it follows that 


BE a l 1 I l 
= G—ae-b) a—b ere) 
The inverse transform of this equation yields 
c(t) = (e" — e” u(t) 
a—b 
Table 4.2: The Laplace Transform Properties 
= Open table as spreadsheet 
[Operation _«dXCS) 
[ Addition a x4(t) + Xo(f) X1(s) + Xo(s) 
[Scalar multiplication [Scalar multiplication [xx(t) | KX) 
sX(s) — x(07) 


Time differentiation = 
dt 
d?x 

dt? 


ax 


s*X(s) —sx(0-) — x(0-) 


s°X(s) — s*x(0-) — sx(0-) —&(0) 


a 
s"X(s) — i gt *yF-1)(0-) 


k=1 


I x(t)dt *X(s) 
1 i 
“xed 5X) + = x(t)dt 
Time [Time shifting | x(t — to)u(t — to) X(s)e7 Sto tp > 0 


[Prenueney anifing ——— 


Frequency differentiation —tx(t 


X(s — So) 
dX{s) 
ds 


Frequency integration x(t) = 
op eens : iy X(z)dz 
s 
Scaling x(at),a = 0 1 x s 
a a 
[Time convolution | x4 (t)xo(t) X1(s) X2(s) 


Frequency convolution x4(t)xo(t) 


1 
——- Xi (s) * X2{s) 
2xj 


x(0*) 


Initial value 
ie oo 


lim sX(s) {n > m) 


Final value X(o0) 


hm sX(s) [poles of sX(s) in LHP] 


Initial and Final Values 


Tu(t)te u(t). 


In certain applications, it is desirable to know the values of x(t) as t — 0 and t — © [initial and final values of x(t)] from the knowledge of its Laplace 
transform X(s). Initial and final value theorems provide such information. 


The initial value theorem states that if x(t) and its derivative dx/dt are both Laplace transformable, then 
x(0') = lim sX(s) (4,33) 
foo 


provided the limit on the right-hand side of Eq. (4.33) exists. 


The final value theorem states that if both x(t) and dx/dt are Laplace transformable, then 


lim x(t) = lim sX(s) (4.34) 


I-60 


provided sX(s) has no poles in the RHP or on the imaginary axis. To prove these theorems, we use Eq. (4.24a) 
OD 


da: 
sX(s) —x(0-) = Oren at 
Jo- dt 


waz 4 © dx 
= —e "dt —e"'dt 
“i dt . ir I. dt sd 


x 


+ dx 
= x()|) + =e" at 
Or 


= x(0*) —x(0- + [oS aL 


+ 


Therefore = 
sX(s) = x(07) + :. ax dt 
ot al 
and . 
jim sX(s) = x(0" ete oe " dt 
=x0°)+ [" a lim e~*’) dt 


= x(0*) 
Comment. The initial value theorem applies only if X(s) is strictly proper (M < N), because for M = N, limg_... SX(s) does not exist, and the theorem 
does not apply. In such a case, we can still find the answer by using long division to express X(s) as a polynomial in s plus a strictly proper fraction, 
where M < N. For example, by using long division, we can express 


$9 +3s7+5+1 2s 
> = (8 + 1) - 
s? +25 +1 s?+25 +1 


The inverse transform of the polynomial in s is in terms of 8(f), and its derivatives, which are zero at t = 0*. In the foregoing case, the inverse 


transform of s + 1 is S(t) + A(t), Hence, the desired x(0*) is the value of the remainder (strictly proper) fraction, for which the initial value theorem 
applies. In the present case 

—25? 
x(0") = jim —————_ = -2 

24+25+1 


To prove the final value theorem, we let s > 0 in Eq. (4.24a) to obtain 


© dy saad | 
lim[s X(s) — x(0 —) a “ar= | a! 


= x(1)|,- = lim x(t) —x@-) 


0o- 
a deduction that leads to the desired result, Eq. (4.34). 


Comment. The final value theorem applies only if the poles of X(s) are in the LHP (including s = 0). If X(s) has a pole in the RHP, x(t) contains an 
exponentially growing term and x(co) does not exist. If there is a pole on the imaginary axis, then x(t) contains an oscillating term and x(co) does not 
exist. However, if there is a pole at the origin, then x(t) contains a constant term, and hence, x(0o) exists and is a constant. 


EXAMPLE 4.9 

Determine the initial and final values of y(t) if its Laplace transform Y(s) is given by 
10(2s +3) 

Y(s)= 


s(s? +25 +5) 


Equations (4.33) and (4.34) yield 


10(2s + 3) 
y(O*) = lim s¥(s) = lim ——~——. = 
WON Ee GA Os 4S) 
10(2s +3) 
= inst) = = 
y(0o) 5415) = 28 +5) 


[t]The dual of the time-differentiation property is the frequency-differentiation property, which states that 
d 
ny) —7, *) 


[t]The dual of the time-integration property is the frequency-integration property, which states that 


t oO 
“ = | X(z)dz 


4.3 SOLUTION OF DIFFERENTIAL AND INTEGRO-DIFFERENTIAL EQUATIONS 


The time-differentiation property of the Laplace transform has set the stage for solving linear differential (or integro-differential) equations with 


constant coefficients. Because dXy/dtk <=> s*Y¥(s), the Laplace transform of a differential equation is an algebraic equation that can be readily solved 
for Y(s). Next we take the inverse Laplace transform of Y(s) to find the desired solution y(t). The following examples demonstrate the Laplace 
transform procedure for solving linear differential equations with constant coefficients. 


EXAMPLE 4.10 


Solve the second-order linear differential equation 

(D? + 5D + 6)y(t) = (D + I)x(t) (4.35a) 
for the initial conditions y(0~) = 2 and ¥(O0~) = Land the input x(t) = e~4¢u(). 
The equation is 


d*y 


dy 
+ s— + 6y(t) = — = + x(f) (4,.35b) 
ae 


Let 
y(t) <=> Y(s) 
Then from Eqs. (4.24) 


uy ==> sY(s) — y(0-) = sY(s) —2 


dt 

and 

d*y 2 =) > 

rf <=> s°Y(s) —sy(0-) — 90") = s*¥(s) —2s —1 
Moreover, for x(t) = e~“fu(t), 

X(s)= and Seep SX) —S(0°) ae ae : 


+4 dt s+4 s+4 
Taking the Laplace transform of Eq. (4.35b), we obtain 


s 1 
Y(s) —2s —1]+5 2] + 6Y(s) = —— 4.36% 
[s?¥(s) ] + S5[s¥(s) — 2] + 6Y(s) ry tue ( 1) 


Collecting all the terms of Y(s) and the remaining terms separately on the left-hand side, we obtain 


s+l 


(s? + 5s + 6)Y(s) — (25 +11) = a (4.36b) 


Therefore 


st1 257 +205 +45 


2 Y(s) = = 
(s“ + 5s + 6)Y(s) +4 734 


and 


2s? + 20s +45 
(s? + 5s + 6)(s + 4) 

2s? + 20s + 45 
(s +2)(s +3)(s +4) 


Expanding the right-hand side into partial fractions yields 
13/2 3 3/2 


$+2 s4+3 s+4 


The inverse Laplace transform of this equation yields 


Y(s) = 


-™ 


y(t) = (Be — 3e-* — Ze) u(t) (4.37) 


Example 4.10 demonstrates the ease with which the Laplace transform can solve linear differential equations with constant coefficients. The method 
is general and can solve a linear differential equation with constant coefficients of any order. 


Zero-Input and Zero-State Components of Response 


The Laplace transform method gives the total response, which includes zero-input and zero-state components. It is possible to separate the two 
components if we so desire. The initial condition terms in the response give rise to the zero-input response. For instance, in Example 4.10, the terms 
attributable to initial conditions y(0”) = 2 and y(0-) = lin Eq. (4.36a) generate the zero-input response. These initial condition terms are —(2s + 


11), as seen in Eq. (4.36b). The terms on the right-hand side are exclusively due to the input. Equation (4.36b) is reproduced below with the proper 
labeling of the terms. 


stl 
(s? +5 +6) ¥(s) — (Qs +11) = 2+ 
s+4 
so that ' 
> s+ 
s*+5s +6) Y(s) = 2s+11 —- 
(s° + 5s +6) ¥(s) Qs+1l) + ta 
initial condition terms ——— 
input terms 
Therefore 
25411 stl 
Y(s):= eS: ii 


s?+5s+6 , (s +4)(s* + 5s + 6) 
—_—_V—_—_—_ —_—_—_—_——X—X— 


zero-inpul component zZero-stale Component 


-| 7 5 |+[24 2 3/2 


s+2 s+3 $+Z s+3 s$+4 
Taking the inverse transform of this equation yields 
y(t) = (7e™ — Se-™) ult) + (—4e-™ + 2e* — Se) u(t) 
a 


zero-input response zeTo-slale response 


COMMENTS ON INITIAL CONDITIONS 
AT 0” AND AT 0* 
The initial conditions in Example 4.10 are y(0") = 2 and v(O~) = 1 it we let t= 0 in the total response in Eq. (4.37), we find y(0) = 2 and 


¥(0) = 2, which is at odds with the given initial conditions. Why? Because the initial conditions are given at t= 0™ (just before the input is applied), 
when only the zero-input response is present. The zero-state response is the result of the input x(t) applied at t = 0. Hence, this component does 


not exist at f= 0. Consequently, the initial conditions at t= 0° are satisfied by the zero-input response, not by the total response. We can readily 
verify in this example that the zero-input response does indeed satisfy the given initial conditions at t = O™. It is the total response that satisfies the 
initial conditions at t = 0*, which are generally different from the initial conditions at O~. 


There also exists a Ly version of the Laplace transform, which uses the initial conditions at t = 0* rather than at 07 (as in our present £ version). 


The Ly version, which was in vogue till the early 1960s, is identical to the £_ version except the limits of Laplace integral [Eq. (4.8)] are from 0* to 
co. Hence, by definition, the origin t = 0 is excluded from the domain. This version, still used in some math books, has some serious difficulties. For 
instance, the Laplace transform of 8(t) is zero because 8(f) = 0 for t > 0*. Moreover, this approach is rather clumsy in the theoretical study of linear 
systems because the response obtained cannot be separated into zero-input and zero-state components. As we know, the zero-state component 
represents the system response as an explicit function of the input, and without knowing this component, it is not possible to assess the effect of the 
input on the system response in a general way. The Li, version can separate the response in terms of the natural and the forced components, 
which are not as interesting as the zero-input and the zero-state components. Note that we can always determine the natural and the forced 
components from the zero-input and the zero-state components [see Eqs. (2.52)], but the converse is not true. Because of these and some other 


problems, electrical engineers (wisely) started discarding the L.. version in the early sixties. 


It is interesting to note the time-domain duals of these two Laplace versions. The classical method is the dual of the L method, and the convolution 


(zero-input/zero-state) method is the dual of the £_ method. The first pair uses the initial conditions at 0*, and the second pair uses those at t = 07. 


The first pair (the classical method and the Ly version) is awkward in the theoretical study of linear system analysis. It was no coincidence that the 
£_ version was adopted immediately after the introduction to the electrical engineering community of state-space analysis (which uses zero- 
input/zero-state separation of the output). 


EXERCISE E4.6 


a 9? 
d*y dy dx ° 
— + 4— + 3y(t) = 2— t) 
a+ ae. yv{t) Fr + X(t) 


for the input x(t) = u(t). The initial conditions are y(0") = 1 and yO) =2. 
Answers 
y(t) = (1 + 9e7! — Tey u(tyu(t) 
EXAMPLE 4.11 


In the circuit of Fig. 4.7a, the switch is in the closed position for a long time before t = 0, when it is opened instantaneously. Find the inductor current 
y(t) for t = 0. 


Geir) 


«&) 


Figure 4.7: Analysis of a network with a switching action. 


When the switch is in the closed position (for a long time), the inductor current is 2 amperes and the capacitor voltage is 10 volts. When the switch is 
opened, the circuit is equivalent to that depicted in Fig. 4.7b, with the initial inductor current y(O) = 2 and the initial capacitor voltage vc(0") = 10. 
The input voltage is 10 volts, starting at t= 0, and, therefore, can be represented by 10u(f). 


The loop equation of the circuit in Fig. 4.7b is 


> + 2y(t) +s ff y(t) dr = 10u(t) (4.38) 
If 

y(t) <=> Y(s) (4.39a) 
then 

dy - 

a <=> sY(s) — y(0-) = sY(s)—2 (4.39b) 


and [see Eq. (4.26)] 


o- 
Y(s) y(r)dr 
+ Loy)dr 


a 
/ y(r)dt — — (4.39¢) 


5 
Because y(t) is the capacitor current, the integral fos y(t)dT is q-(0 ), the capacitor charge at t = 0°, which is given by C times the capacitor 
voltage at t = O-. Therefore 


o- 
/ y(t) dt =qc(0-) = Cue (0) = 2(10) = 2 


oo 


From Eq. (4.39c) it follows that 


j Y 2 
. y(t)dt = — + : (4.40) 


Taking the Laplace transform of Eq. (4.38) and using Eqs. (4.39a), (4.39b), and (4.40), we obtain 


5Y(s) 10 10 
s¥(s) —2+4+2Y¥(s) + (s) oh cate SR eee 


AY AY Ss 


or 


5 
s+24>] Y(s)=2 


and 


2 
¥(s)= : 


s?+254+5 
To find the inverse Laplace transform of Y(s), we use pair 10c (Table 4.1) with values A = 2, B=0, a= 1, and c= 5. This yields 
2=J5, b=Vc-a?=2 and O=tan' (2) = 266 


r= >” Y 


Therefore 
y(t) = V5e™ cos (2t + 26.6°)u(t) 
This response is shown in Fig. 4.7c. 


Comment. In our discussion so far, we have multiplied input signals by u(t), implying that the signals are zero prior to t = 0. This is needlessly 
restrictive. These signals can have any arbitrary value prior to t = 0. As long as the initial conditions at tf = 0 are specified, we need only the 
knowledge of the input for f => 0 to compute the response for t > 0. Some authors use the notation 1(t) to denote a function that is equal to u(t) for ¢ 
> 0 and that has arbitrary value for negative t. We have abstained from this usage to avoid needless confusion caused by introduction of a new 
function, which is very similar to u(f). 


4.3-1 Zero-State Response 
Consider an Nth-order LTIC system specified by the equation 
O(D)y(t) = P(D)x(t) 
or 
(D¥ 4a, D*"' +---+ay 1D+an)y(t) = (bo D* +b, D*' +---+by 1D+by)x(t) Al) 


We shall now find the general expression for the zero-state response of an LTIC system. Zero-state response y(t), by definition, is the system 
response to an input when the system is initially relaxed (in zero state). Therefore, y(t) satisfies the system equation (4.41) with zero initial conditions 


y(0-) = (0°) = 0°) =--- = yO) =0 
Moreover, the input x(t) is causal, so that 
x0") =£(0°) = £07) =~ = 9) =0 
Let 
y(t) <=> Y(s) and x(t) <> X(s) 
Because of rain initial conditions 
D' y(t) = “yl <> s'¥(s) 

k 


d 
D‘ x(t) = ax) ==> s*X(s) 


Therefore, the Laplace transform of Eq. (4.41) yields 


(s¥+ ays "+--+ +ayas +aw)¥(s) = (bos®+ bis "+ ++ + by as + by) X(s) 
or 
bos® + bs! + ~~. + by is + by 
Y(s)= ls 8 1 AM ea BS aL (4.42a) 
S* + aS"! +++ + Anis + ay 
P(s) 
= £') ¥ (5) (4.42b) 
O(s) 
But we have shown in Eq. (4.31) that Y(s) = H(s)X(s). Consequently, 
P(s) 
H(s) = —— (4.43) 
O(s) 


This is the transfer function of a linear differential system specified in Eq. (4.41). The same result has been derived earlier in Eq. (2.50) using an 


alternate (time-domain) approach. 


We have shown that Y(s), the Laplace transform of the zero-state response y(t), is the product of X(s) and H(s), where X(s) is the Laplace 
transform of the input x(t) and H(s) is the system transfer function [relating the particular output y(t) to the input x(f)]. 


INTUITIVE INTERPRETATION OF THE LAPLACE TRANSFORM 

So far we have treated the Laplace transform as a machine, which converts linear integro-differential equations into algebraic equations. There is no 
physical understanding of how this is accomplished or what it means. We now discuss a more intuitive interpretation and meaning of the Laplace 
transform. 


In Chapter 2, Eq. (2.47), we showed that LTI system response to an everlasting exponential estis H (s)e“. If we could express every signal as a 


st 


linear combination of everlasting exponentials of the form e*, we could readily obtain the system response to any input. For example, if 


K 
x(t) = >> X(s)e™ 


k=1 
The response of an LTIC system to such input x(t) is given by 
K 
y(t) = > X(s,)H(s;)e" 
k=1 


Unfortunately, a very small class of signals can be expressed in this form. However, we can express almost all signals of practical utility as a sum of 
everlasting exponentials over a continuum of frequencies. This is precisely what the Laplace transform in Eq. (4.2) does. 


l c+ Joo 
x() = = / X(s)e" ds (4.44) 
2rj ¢-jo 
Invoking the linearity property of the Laplace transform, we can find the system response y(t) to input x(t) in Eq. (4.44) asiT] 


c+ jex 
| X(s)H(s)e" ds 
joo 


Pa 


l 
Pp > j 


= £7'X(s)H(s) (4.45) 


Clearly 
Y(s) = X(s)H(s) 


We can now represent the transformed version of the system, as depicted in Fig. 4.8a. The input X(s) is the Laplace transform of x(t), and the output 
Y(s) is the Laplace transform of (the zero-input response) y(t). The system is described by the transfer function H(s). The output Y(s) is the product 
X(s)H(s). 

Nis Yis) = HisXGs) wh 
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— 
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Figure 4.8: Alternate interpretation of the Laplace transform. 


Recall that s is the complex frequency of et. This explains why the Laplace transform method is also called the frequency-domain method. Note that 


X(s), Y(s), and H(s) are the frequency-domain representations of x(t), y(t), and h(t), respectively. We may view the boxes marked £ and Loin Fig. 
4.8a as the interfaces that convert the time-domain entities into the corresponding frequency-domain entities, and vice versa. All real-life signals 
begin in the time domain, and the final answers must also be in the time domain. First, we convert the time-domain input(s) into the frequency- 
domain counterparts. The problem itself is solved in the frequency domain, resulting in the answer Y(s), also in the frequency domain. Finally, we 
convert Y(s) to y(t). Solving the problem is relatively simpler in the frequency domain than in the time domain. Henceforth, we shall omit the explicit 


representation of the interface boxes £ and fa representing signals and systems in the frequency domain, as shown in Fig. 4.8b. 


THE DOMINANCE CONDITION 
In this intuitive interpretation of the Laplace transform, one problem should have puzzled the reader. In Section 2.5 (classical solution of differential 


equations), we showed in Eq. (2.57) that an LTI system response to input et is H(s) est plus characteristic mode terms. In the intuitive interpretation, 
an LTI system response is found by adding the system responses to all the infinite exponential components of the input. These components are 


exponentials of the form est starting at t= — oo. We showed in Eq. (2.47) that the response to everlasting input et is also an everlasting exponential 
H(s) e®!. Does this result not conflict with the result in Eq. (2.57)? Why are there no characteristic mode terms in Eq. (2.47), as predicted by Eq. 
(2.57)? The answer is that the mode terms are also present. The system response to an everlasting input et is indeed an everlasting exponential 
H(s) et plus mode terms. All these signals start at t = — oo. Now, if a mode edi is such that it decays faster than (or grows slower than) e®, that is, if 


Re A; < Re s, then after some time interval, e* will be overwhelmingly stronger than edt and hence will completely dominate such a mode term. In 


such a case, at any finite time (which is long time after the start at tf = — co), we can ignore the mode terms and say that the complete response is 
st 


H(s) e . Hence, we can reconcile Eq. (2.47) to Eq. (2.57) only if the dominance condition is satisfied, that is, if Re A; < Re s for all i. If the 


dominance condition is not satisfied, the mode terms dominate e® and Eq. (2.47) does not hold.[10] 


Careful examination shows that the dominance condition is implied in Eq. (2.47). This is because of the caviat in Eq. (2.47) that the response of an 
LTIC system to everlasting e* is H(s) et, provided H(s) exists (or converges). We can show that this condition amounts to dominance condition. If a 
system has characteristic roots ?4, ?9, ..., Ay, then A(t) consists of exponentials of the form eAit (i= 1, 2, ..., N) and the convergence of H (s) 
requires that Re s > Re A; for j= 1, 2, ..., N, which precisely is the dominance condition. Clearly, the dominance condition is implied in Eq. (2.47), 


and also in the entire fabric of the Laplace transform. It is interesting to note that the elegant structure of convergence in Laplace transform is rooted 
in such a lowly, mundane origin, as Eq. (2.57). 


EXAMPLE 4.12 

Find the response y(t) of an LTIC system described by the equation 
d*y dy dx 

— +5— + 6y(t) = — + x(t) 

dr? di dt 


if the input x(t) = 3e tut) and all the initial conditions are zero; that is, the system is in the zero state. 


The system equation is 


(D? + 5D +6) y(t) = (D +1) x(t) 
—$—$——S —— 


ocd) P(D) 
Therefore 
P(s) | s+l 
i Os) s?+55+6 
Also ; 
51 : 
X(s) = Le “u(t)] = 715 
and ry 1) 
3(s + 
OAV GG +Sra 6) 
_ 3(s + 1) 
~ (5 +5)(s + 2)(s +3) 
—2 l 3 


= - + 
s+5 st+2 s+3 
The inverse Laplace transform of this equation is 
y(t) = (—2e* — e * 43e™)u(t) 


EXAMPLE 4.13 


Show that the transfer function of | 


a. an ideal delay of T seconds is est 
b. an ideal differentiator is s 
c. an ideal integrator is 1/s 


a. Ideal Delay. For an ideal delay of T seconds, the input x(t) and output y(t) are related by 


y(t) = x(t —T) 
or 
Y(s)=X(s)e? —_ [see Eq. (4.19a)] 
Therefore 
Y(s) r 
H(s) = =e* 4.46 
5) Xs) e (4.46) 
b. Ideal Differentiator. For an ideal differentiator, the input x(t) and the output y(t) are related by 
dx 
(j=— 
y(t) dt 


The Laplace transform of this equation yields 


Y(s) =sX(s) [x(0-) = 0 for a causal signal] 


and 


Y(s) 


H =enm — f/f 
ls 7 


(4.47) 


c. Ideal Integrator. For an ideal integrator with zero initial state, that is, y(O") = 0, 
t 


y= f x(t)dt 
0 


and 


l 
Y(s) = —X(s) 
Ss 


Therefore 
I 
H(s)=- (4.48) 
Ss 
EXERCISE E4.7 
For an LTIC system with transfer function 5 
s+5 z 
H#(s) =-———— 
s?+45+3 
a. Describe the differential equation relating the input x(t) and output y(t). 
b. Find the system response y(f) to the input x(t) = e tut) if the system is initially in zero 
state. 
Answers 
a. 
dy dy dx 
— +4— + 3y(t) = — + Sx(t) 
dt? dt . dt 
b. y(t) = (2e-' — 3e°2! — 36°28 + e Styu(t) 
4.3-2 Stability 


Equation (4.43) shows that the denominator of H(s) is Q(s), which is apparently identical to the characteristic polynomial Q(A) defined in Chapter 2. 
Does this mean that the denominator of H(s) is the characteristic polynomial of the system? This may or may not be the case, since if P(s) and 
Q(s) in Eq. (4.43) have any common factors, they cancel out, and the effective denominator of H(s) is not necessarily equal to Q(s). Recall also that 
the system transfer function H(s), like h(t), is defined in terms of measurements at the external terminals. Consequently, H(s) and A(t) are both 
external descriptions of the system. In contrast, the characteristic polynomial Q(s) is an internal description. Clearly, we can determine only external 
stability, that is, BIBO stability, from H(s). If all the poles of H(s) are in LHP, all the terms in h(t) are decaying exponentials, and h(t) is absolutely 


integrable [see Eq. (2.64)). [71 Consequently, the system is BIBO stable. Otherwise the system is BIBO unstable. 


BvT Boss rm SURE 
THE POLES WERE iW 
THE LEFT Wace PLANE! 


Beware of the RHP poles! 
Beware of the RHP poles! 


So far, we have assumed that H(s) is a proper function, that is, M = N. We now show that if H(s) is improper, that is, if M > N, the system is BIBO 
unstable. In such a case, using long division, we obtain H(s) = R(s) + H’(s), where R(s) is an (M — N)th-order polynomial and H’(s) is a proper 
transfer function. For example, 


si +4s? +45 +5 s°+2s¢+5 


H(s)= ~ =S§ Th 
s*+35+2 s*+35+2 


(4.49) 


As shown in Eq. (4.47), the term s is the transfer function of an ideal differentiator. If we apply step function (bounded input) to this system, the 
output will contain an impulse (unbounded output). Clearly, the system is BIBO unstable. Moreover, such a system greatly amplifies noise because 
differentiation enhances higher frequencies, which generally predominate in a noise signal. These are two good reasons to avoid improper systems 
(M > N). In our future discussion, we shall implicitly assume that the systems are proper, unless stated otherwise. 


If P(s) and Q(s) do not have common factors, then the denominator of H(s) is identical to Q(s), the characteristic polynomial of the system. In this 
case, we can determine internal stability by using the criterion described in Section 2.6. Thus, if P(s) and Q(s) have no common factors, the 
asymptotic stability criterion in Section 2.6 can be restated in terms of the poles of the transfer function of a system, as follows: 


1. An LTIC system is asymptotically stable if and only if all the poles of its transfer function H(s) are in the LHP. The poles may be simple 
or repeated. 


2. An LTIC system is unstable if and only if either one or both of the following conditions exist: (i) at least one pole of H(s) is in the RHP; 
(ii) there are repeated poles of H(s) on the imaginary axis. 


3. An LTIC system is marginally stable if and only if there are no poles of H(s) in the RHP and some unrepeated poles on the imaginary 
axis. 


Location of zeros of H(s) have no role in determining the system stability. 


EXAMPLE 4.14 
Figure 4.9a shows a cascade connection of two LTIC systems S} followed by S>. The transfer functions of these systems are H, (s) = 1/(s — 1) and 
Ho(s) = (Ss — 1)(s + 1), respectively. We shall find the BIBO and asymptotic stability of the composite (cascade) system. 


Oa oe yt!) 
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Figure 4.9: Distinction between BIBO and asymptotic stability. 


If the impulse response of S) and S> are h,(t) and h(t), respectively, then the impulse response of the cascade system is h(t) = h(t) * ho(t). 
Hence, H(s) = H1(s)H2(s). In the present case, 


1s) = ( \()- 
—N\gm1TJ\s41/ +1 


The pole of S) at s = 1 cancels with the zero at s = 1 of S>. This results in a composite system having a single pole at s = — 1. If the composite 
cascade system were to be enclosed inside a black box with only the input and the output terminals accessible, any measurement from these 
external terminals would show that the transfer function of the system is 1/(s + 1), without any hint of the fact that the system is housing an unstable 
system (Fig. 4.9b). 


The impulse response of the cascade system is h(t) = efu(t), which is absolutely integrable. Consequently, the system is BIBO stable. 


To determine the asymptotic stability, we note that § has one characteristic root at 1, and S> also has one root at — 1. Recall that the two systems 
are independent (one does not load the other), and the characteristic modes generated in each subsystem are independent of the other. Clearly, the 


mode e? will not be eliminated by the presence of S». Hence, the composite system has two characteristic roots, located at +1, and the system is 
asymptotically unstable, though BIBO stable. 


Interchanging the positions of Si and S> makes no difference in this conclusion. This example shows that BIBO stability can be misleading. If a 
system is asymptotically unstable, it will destroy itself (or, more likely, lead to saturation condition) because of unchecked growth of the response due 
to intended or unintended stray initial conditions. BIBO stability is not going to save the system. Control systems are often compensated to realize 
certain desirable characteristics. One should never try to stabilize an unstable system by canceling its RHP pole(s) by RHP zero(s). Such a 
misguided attempt will fail, not because of the practical impossibility of exact cancellation but for the more fundamental reason, as just explained. 


EXERCISE E4.8 
Show that an ideal integrator is marginally stable but BIBO unstable. 


4.3-3 Inverse Systems 


If H(s) is the transfer function of a system S, then Si, its inverse system has a transfer function Hj(s) given by 


1 
H;(s) = —-~ 
; H(s) 
This follows from the fact the cascade of S with its inverse system Siis an identity system, with impulse response 8(f), implying H(s)H,(s) = 1. For 
example, an ideal integrator and its inverse, an ideal differentiator, have transfer functions 1/s and s, respectively, leading to H(s)Hj(s) = 1. 


[t]Recall that H(s) has its own region of validity. Hence, the limits of integration for the integral in Eq. (4.44) are modified in Eq. (4.45) to 
accommodate the region of existence (validity) of X(s) as well as H(s). 


[10], athi, B. P. Signals, Systems, and Communication. Wiley, New York, 1965. 


[tlvalues of s for which H(s) is 0 are the poles of H(s). Thus poles of H(s) are the values of s for which the denominator of H(s) is zero. 


4.4 ANALYSIS OF ELECTRICAL NETWORKS: THE TRANSFORMED NETWORK 


Example 4.10 shows how electrical networks may be analyzed by writing the integro-differential equation(s) of the system and then solving these 
equations by the Laplace transform. We now show that it is also possible to analyze electrical networks directly without having to write the integro- 
differential equations. This procedure is considerably simpler because it permits us to treat an electrical network as if it were a resistive network. For 
this purpose, we need to represent a network in the "frequency domain" where all the voltages and currents are represented by their Laplace 
transforms. 


For the sake of simplicity, let us first discuss the case with zero initial conditions. If v(t) and i(t) are the voltage across and the current through an 
inductor of L henries, then 


di 
th= L— 
u(t) FP 


The Laplace transform of this equation (assuming zero initial current) is 


Vis) = LsI(s) 


Similarly, for a capacitor of C farads, the voltage-current relationship is i(t) = C(dv/dt) and its Laplace transform, assuming zero initial capacitor 
voltage, yields /(s) = CsV(s); that is, 


I 
V(s) = —I 
(s) Cs (Ss) 


For a resistor of R ohms, the voltage-current relationship is v(t) = Ri(t), and its Laplace transform is 

V(s) = RI(s) 

Thus, in the "frequency domain," the voltage-current relationships of an inductor and a capacitor are algebraic; these elements behave like resistors 
of "resistance" Ls and 1/Cs, respectively. The generalized "resistance" of an element is called its impedance and is given by the ratio V(s)/I(s) for the 


element (under zero initial conditions). The impedances of a resistor of R ohms, an inductor of L henries, and a capacitance of C farads are R, Ls, 
and 1/Cs, respectively. 


Also, the interconnection constraints (Kirchhoff's laws) remain valid for voltages and currents in the frequency domain. To demonstrate this point, let 
v(t) = 1, 2, ..., k) be the voltages across k elements in a loop and let i(t)(/ = 1, 2, ..., m) be the j currents entering a node. Then 
k 


Sou(t}=0 and = Soij(t)=0 
j=l j=l 

Now if 7 ; 
uj(t) => V;(s) and i;(t) — > J;(s) 


then 
k m 
YoVj(s)=0 and =o (s) =0 (4.50) 
jel jm 


This result shows that if we represent all the voltages and currents in an electrical network by their Laplace transforms, we can treat the network as if 
it consisted of the "resistances" R, Ls, and 1/Cs corresponding to a resistor R, an inductor L, and a capacitor C, respectively. The system equations 
(loop or node) are now algebraic. Moreover, the simplification techniques that have been developed for resistive circuits-equivalent series and parallel 
impedances, voltage and current divider rules, Thevenin and Norton theorems-can be applied to general electrical networks. The following examples 
demonstrate these concepts. 


EXAMPLE 4.15 
Find the loop current i(t) in the circuit shown in Fig. 4.10a if all the initial conditions are zero. 


lOwtr) & 


Figure 4.10: (a) A circuit and (b) its transformed version. 


In the first step, we represent the circuit in the frequency domain, as illustrated in Fig. 4.10b. All the voltages and currents are represented by their 
Laplace transforms. The voltage 10u(t) is represented by 10/s and the (unknown) current i(f) is represented by its Laplace transform /(s). All the 
circuit elements are represented by their respective impedances. The inductor of 1 henry is represented by s, the capacitor of 1/2 farad is 
represented by 2/s, and the resistor of 3 ohms is represented by 3. We now consider the frequency-domain representation of voltages and currents. 
The voltage across any element is /(s) times its impedance. Therefore, the total voltage drop in the loop is /(s) times the total loop impedance, and it 
must be equal to V(s), (transform of) the input voltage. The total impedance in the loop is 

2 s°+3s+2 
Z(s)=5+3+== 


The input "voltage" is V(s) = 10/s. Therefore, the "loop current" /(s) is 
V(s) 10/s 10 10 10 10 


I(s)=>— = =— = = 
Zis)) (s*+3s+2)/s  s?4+3s42 (s+1)0(8+2) s+l1 54+2 


The inverse transform of this equation yields the desired result: 

i(t) = 10(e — e™ u(t) 

INITIAL CONDITION GENERATORS 

The discussion in which we assumed zero initial conditions can be readily extended to the case of nonzero initial conditions because the initial 
condition in a capacitor or an inductor can be represented by an equivalent source. We now show that a capacitor C with an initial voltage v(O7) (Fig. 
4.11a) can be represented in the frequency domain by an uncharged capacitor of impedance 1/Cs in series with a voltage source of value v(O")/s 
(Fig. 4.11b) or as the same uncharged capacitor in parallel with a current source of value Cv(0") (Fig. 4.11¢). Similarly, an inductor L with an initial 
current i(0-) (Fig. 4.11d) can be represented in the frequency domain by an inductor of impedance Ls in series with a voltage source of value Li(0") 


(Fig. 4.11e) or by the same inductor in parallel with a current source of value i(0”)/s (Fig. 4.11f). To prove this point, consider the terminal 
relationship of the capacitor in Fig. 4.11a 
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Figure 4.11: Initial condition generators for a capacitor and an inductor. 


The Laplace transform of this equation yields 


I(s) = C[sV(s) — v(0)] 
This equation can be rearranged as 
v(0-) 


s§ 


] 
V(s) = o/s) + (4.5 la) 


Observe that V(s) is the voltage (in the frequency domain) across the charged capacitor and /(s)/Cs is the voltage across the same capacitor without 


any charge. Therefore, the charged capacitor can be represented by the uncharged capacitor in series with a voltage source of value v(0)/s, as 
depicted in Fig. 4.11b. Equation (4.51a) can also be rearranged as 


1 
Vis) = G, Les) + CuO") (4.51b) 


This equation shows that the charged capacitor voltage V(s) is equal to the uncharged capacitor voltage caused by a current /(s) + Cv(07). This 


result is reflected precisely in Fig. 4.11c, where the current through the uncharged capacitor is /(s) + cv(o7).[t] 
For the inductor in Fig. 4.11d, the terminal equation is 


di 
th)= L— 
u(t) a 


and 
V(s) = L[s7(s) —i(0-)] 
= LsI(s) — Li(0-) (4.52a) 
i(0 
= 16) _ a (4.52b) 
We can verify that Fig. 4.11e satisfies Eq. (4.52a) and that Fig. 4.11f satisfies Eq. (4.52b). 


Let us rework Example 4.11 using these concepts. Figure 4.12a shows the circuit in Fig. 4.7b with the initial conditions y(O") = 2 and v,(0) = 10. 
Figure 4.12b shows the frequency-domain representation (transformed circuit) of the circuit in Fig. 4.12a. The resistor is represented by its 
impedance 2; the inductor with initial current of 2 amperes is represented according to the arrangement in Fig. 4.11e with a series voltage source 


Ly(0") = 2. The capacitor with initial voltage of 10 volts is represented according to the arrangement in Fig. 4.11b with a series voltage source v(0)/s 
= 10/s. Note that the impedance of the inductor is s and that of the capacitor is 5/s. The input of 10u(t) is represented by its Laplace transform 10/s. 


s 


fa) (b) 


Figure 4.12: A circuit and its transformed version with initial condition generators. 
The total voltage in the loop is (10/s) + 2 — (10/s) = 2, and the loop impedance is (s + 2 + (5/s)). Therefore 
2s 
Y(s) = 


$+2+5/s 
2s 


$?+ 2545 
which confirms our earlier result in Example 4.11. 
EXAMPLE 4.16 


The switch in the circuit of Fig. 4.13a is in the closed position for a long time before ¢t = 0, when it is opened instantaneously. Find the currents y4 (t) 
and yo(t) for t= 0. 


ib) te) 


Figure 4.13: Using initial condition generators and Thévenin equivalent representation. 


Inspection of this circuit shows that when the switch is closed and the steady-state conditions are reached, the capacitor voltage v, = 16 volts, and 


the inductor current y2 = 4 amperes. Therefore, when the switch is opened (at f = 0), the initial conditions are v,(0) = 16 and y2(0 ) = 4. Figure 


4.13b shows the transformed version of the circuit in Fig. 4.13a. We have used equivalent sources to account for the initial conditions. The initial 
capacitor voltage of 16 volts is represented by a series voltage of 16/s and the initial inductor current of 4 amperes is represented by a source of 


value Ly2(0~) = 2 


From Fig. 4.13b, the loop equations can be written directly in the frequency domain as 


Yi(s I 4 
ie + =1¥i(s) — Y2{s)] = < 


Ss 5 


\ 6 : 
~=Y,(s) + 2¥2(s) + =¥o(s) =2 
5 5 
b+i -} 


5 
-} $48] [y(s)| [2 


Application of Cramer 's rule to this equation yields 


IA(s + 2° 
_ _24(s +2) 
(s + 3)(s +4) 
ph 
s+3 s+4 


and 


y(t) = (—24e-* + 48e~ u(t) 


Similarly, we obtain 


4(s +7) 
Y3(s) = ————_——— 
US) = 34-78 +12 
6 2 
~ +3 st+4 
and 


y2(t) = (16e~" — 12e™ )u(t) 


We also could have used Thévenin's theorem to compute Y1(s) and Y2(s) by replacing the circuit to the right of the capacitor (right of terminals ab) 
with its Thévenin equivalent, as shown in Fig. 4.13c. Figure 4.13b shows that the Thévenin impedance Z(s) and the Thévenin source V(s) are 


s(t) | s+2 


Z(s) = 


Bol ~ 55 +12 
re hea 
1 
& —4 
V(s) = = 
1s 5s +12 
st5ztl 


According to Fig. 4.13c, the current Y;(s) is given by 


4 
<~VG) = 24(8 +2) 

OFT egy he 
ry +Z(s) ~ 


which confirms the earlier result. We may determine Y2(s) in a similar manner. 


EXAMPLE 4.17 


The switch in the circuit in Fig. 4.14a is at position a for a long time before t = 0, when it is moved instantaneously to position b. Determine the 
current y;(t) and the output voltage vo(t) for f= 0. 


4) 


Figure 4.14: Solution of a coupled inductive network by the transformed circuit method. 


Just before switching, the values of the loop currents are 2 and 1, respectively, that is, y,;(0) = 2 and y2(0 ) = 1. 


The equivalent circuits for two types of inductive coupling are illustrated in Fig. 4.14b and 4.14c. For our situation, the circuit in Fig. 4.14c applies. 
Figure 4.14d shows the transformed version of the circuit in Fig. 4.14a after switching. Note that the inductors L, + M, Lz + M, and — M are 3,4, and 
—1 henries with impedances 3s, 4s, and —s respectively. The initial condition voltages in the three branches are (L1 + M)y; (0) = 6, (Lo + 


M)y2(0-) = 4, and —M[y; (0°) — y2(0 )] = — 1, respectively. The two loop equations of the circuit arelt] 


10 
(2s +3)¥,(s) + (s — 1)¥2(s) = — +5 
s (4.53) 


(s — 1)¥,(s) + 3s +2)¥2(s) =5 


or 
2s+3 s—1] [Yi(s)] FE” 
s—1 35+2] | Yo(s) 5 


and gi 
+95 +4 
YS) = S624 35 41) 
_4 1 1 
~ s $+0.382 $s +2.618 
Therefore 
y(t) = (4 — e 08% — 9218) y(t) 
Similarly : 
s*+2s4+2 
a CESTE SD) 
_2 1618 m 0.618 
s s+0.382 s+2.618 
and 


yo(t) = (2 — 1.618 ° 8” + 0.618e- 2" yu (rt) 


The output voltage 


vo(t) = yo(t) = (2 — 1.618e~°*” + 0.618e7"* yu(t) 


EXERCISE E4.9 


For the RLC circuit in Fig. 4.15, the input is switched on at t = 0. The initial conditions are y(0") = 2 amperes and v,(0" ) BF 


= 50 volts. Find the loop current y(t) and the capacitor voltage v,(t) for = 0. 


t=0 20 1H 


24V 


Figure 4.15 


Answers 


y(t) = 10\/2e! cos (2t + 81.8°)u(t) 
Ve(t) = [24 + 31.62e7! cos (2t — 34.7°)Ju(t) 


4.4-1 Analysis of Active Circuits 


Although we have considered examples of only passive networks so far, the circuit analysis procedure using the Laplace transform is also applicable 
to active circuits. All that is needed is to replace the active elements with their mathematical models (or equivalent circuits) and proceed as before. 


The operational amplifier (depicted by the triangular symbol in Fig. 4.16a) is a well-known element in modern electronic circuits. The terminals with 
the positive and the negative signs correspond to noninverting and inverting terminals, respectively. This means that the polarity of the output voltage 
V2 is the same as that of the input voltage at the terminal marked by the positive sign (noninverting). The opposite is true for the inverting terminal, 
marked by the negative sign. 


‘——_ —— 
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Figure 4.16: Operational amplifier and its equivalent circuit. 


Figure 4.16b shows the model (equivalent circuit) of the operational amplifier (op amp) in Fig. 4.16a. A typical op amp has a very large gain. The 


output voltage v2 = —Av4, where A is typically 10° to 10°. The input impedance is very high, of the order of 1012 Q and the output impedance is 
very low (50-100 Q). For most applications, we are justified in assuming the gain A and the input impedance to be infinite and the output impedance 
to be zero. For this reason we see an ideal voltage source at the output. 


Consider now the operational amplifier with resistors Ra and Rp connected, as shown in Fig. 4.16c. This configuration is known as the noninverting 


amplifier. Observe that the input polarities in this configuration are inverted in comparison to those in Fig. 4.16a. We now show that the output 
voltage v2 and the input voltage v, in this case are related by 


vo = Ky, K=-1+— (4,54) 
First, we recognize that because the input impedance and the gain of the operational amplifier approach infinity, the input current i, and the input 
voltage v, in Fig. 4.16c are infinitesimal and may be taken as zero. The dependent source in this case is Av, instead of —Av, because of the input 
polarity inversion. The dependent source Av, (see Fig. 4.16b) at the output will generate current io, as illustrated in Fig. 4.16c. Now 


n= (R, + Radio 


also 
vy = Vy + Raia 


= Rain 


Therefore 


vi R, R, 

or 

u(t) = Kv, (1) 

The equivalent circuit of the noninverting amplifier is depicted in Fig. 4.16d. 


EXAMPLE 4.18 
The circuit in Fig. 4.17a is called the Sallen-Key circuit, which is frequently used in filter design. Find the transfer function H(s) relating the output 
voltage v,(t) to the input voltage v;(t). 


Figure 4.17: (a) Sallen-Key circuit and (b) its equivalent. 


We are required to find 


V.(s) 
A(s) = 
? Vi(s) 


assuming all initial conditions to be zero. 


Figure 4.17b shows the transformed version of the circuit in Fig. 4.17a. The noninverting amplifier is replaced by its equivalent circuit. All the voltages 
are replaced by their Laplace transforms and all the circuit elements are shown by their impedances. All the initial conditions are assumed to be zero, 
as required for determining H(s). 


We shall use node analysis to derive the result. There are two unknown node voltages, V4(s) and Vp(s) requiring two node equations. 


At node a, /p,(s), the current in Ry (leaving the node a), is [Va(s) — Vj(s)|/Ra], Similarly, /p, (s), the current in Ro (leaving the node a), is [Va(s) — 
Vp(s)]R2, and Ic, (Ss), the current in capacitor C1 (leaving the node a), is [Va(s) — Va(s)]C1s = [Va(s) — KVp(s)]C1s. 


The sum of all the three currents is zero. Therefore 


Va(s) — Vi(s) , Vals) — Vols 
Ve(s) — Vi(s) je [Va(s) — KV,(s)]Cis = 0 


Ri Ro 
or 
(; pe +G;8) Vo) (3 +KGis) Vis) = 1 vs) (4.55a) 
Ri R: 1 a R; 1 6 vam Ri i ° 


Similarly, the node equation at node b yields 


V,(s) — Vis" 
Vo(s) — Vals) + CosVi(s) = 0 
R, 


or 


1 1 
meee ff wae ss | V, — 4, 
RB a(S) + (+ +¢;s) p(s) =0 (4.55b) 


The two node equations (4.55a) and (4.55b) in two unknown node voltages V,(s) and Vp(s) can be expressed in matrix form as 


Gi +G2+Cis =—(G2+ KCis)| | Vols) _ G1 V,(s) (4.56) 
-G, (G2+Cs) ||Viis)} | 0 


1 l 
G,;=— and G» = 
. a | R 
Application of Cramer 's rule to Eq. (4.56) yields 
V,(s) G,G, 
Vi(s) ~ C, C258? + [G,;C2 + G2C2 + G2C, (1 — K)]s + G, G2 
she we 
s? + 2as + wo? 
where 
Ry » GG l 
K=-1+— and == => 4.57% 
+ R. in wo CG RRC ( 1) 
GC, + GC; + GC (1 — K) I | I 
aC "Ro tha that ™ (4.57b) 
Now _ 
V.(s) = K V,(s) 
Therefore 
V,(s) Vi (s) Kan? 
H(s) = =K =-—- 4.58 
“) Vi (Ss) Vi(s) = 62. + 2as +a? ( 


[tlIn the time domain, a charged capacitor C with initial voltage v(0”) can be represented as the same capacitor uncharged in series with a voltage 
source v(0")u(t) or in parallel with a current source Cv(0" )8(t). Similarly, an inductor L with initial current (0~) can be represented by the same 
inductor with zero initial current in series with a voltage source Li(O”)8(t) or with a parallel current source i(0”)u(t). 


[tlThe time domain equations (loop equations) are 


10u(z) 


dy dy 
Le + (Ri + Ro)yi(1) — Royal) + M—* 


0 


dy; dy2 x2 
M— — Royi(t) + Lh + (Rz + R3)y2(t) 


The Laplace transform of these equations yields Eq. (4.53). 


4.5 BLOCK DIAGRAMS 


Large systems may consist of an enormous number of components or elements. As anyone who has seen the circuit diagram of a radio or a 
television receiver can appreciate, analyzing such systems all at once could be next to impossible. In such cases, it is convenient to represent a 
system by suitably interconnected subsystems, each of which can be readily analyzed. Each subsystem can be characterized in terms of its input- 
output relationships. A linear system can be characterized by its transfer function H(s). Figure 4.18a shows a block diagram of a system with a 
transfer function H(s) and its input and output X(s) and Y(s), respectively. 


Subsystems may be interconnected by using cascade, parallel, and feedback interconnections (Fig. 4.18b, 4.18c, 4.18d), the three elementary types. 
When transfer functions appear in cascade, as depicted in Fig. 4.18b, then, as shown earlier, the transfer function of the overall system is the 
product of the two transfer functions. This result can also be proved by observing that in Fig. 4.18b 


Y(s) W(s) Y(s) 


Xis) Wis} Yis) Xis) Yis) 
—-— He -—— AY - -— Hiss) —— 


Hyis) 


Nis) Yu) Xs) Yis) 


=- —— 1G)+he) -—-— 
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S 
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Figure 4.18: Elementary connections of blocks and their equivalents. 


We can extend this result to any number of transfer functions in cascade. It follows from this discussion that the subsystems in cascade can be 
interchanged without affecting the overall transfer function. This commutation property of LTI systems follows directly from the commutative (and 
associative) property of convolution. We have already proved this property in Section 2.4-3. Every possible ordering of the subsystems yields the 
same overall transfer function. However, there may be practical consequences (such as sensitivity to parameter variation) affecting the behavior of 
different ordering. 


Similarly, when two transfer functions, H(s) and H2(s), appear in parallel, as illustrated in Fig. 4.18c, the overall transfer function is given by H4(s) + 
H>(s), the sum of the two transfer functions. The proof is trivial. This result can be extended to any number of systems in parallel. 


When the output is fed back to the input, as shown in Fig. 4.18d, the overall transfer function Y(s)/X(s) can be computed as follows. The inputs to 
the adder are X(s) and —H(s)¥(s). Therefore, E(s), the output of the adder, is 
E(s) = X(s) — H{s)¥(s) 


But 
Y(s) = G(s)E(s) 


= G(s)[X(s) — H(s)¥(s)| 


Therefore _ 
Y(s)[1 + G(s) H(s)] = G(s)X(s) 
so that 

Y(s) G(s) 


X(s) 14+ G(s)H(s) 
Therefore, the feedback loop can be replaced by a single block with the transfer function shown in Eq. (4.59) (see Fig. 4.18d). 


In deriving these equations, we implicitly assume that when the output of one subsystem is connected to the input of another subsystem, the latter 
does not load the former. For example, the transfer function H, (s) in Fig. 4.18b is computed by assuming that the second subsystem H2(s) was not 
connected. This is the same as assuming that Hz (s) does not load H, (s). In other words, the input-output relationship of H4(s) will remain 
unchanged regardless of whether H2(s) is connected. Many modern circuits use op amps with high input impedances, so this assumption is justified. 
When such an assumption is not valid, H; (s) must be computed under operating conditions [i.e., with H2(s) connected]. 


COMPUTER EXAMPLE C4.3 
Using the feedback system ofFig 4.18d with G(s) = K/(s(s + 8)) and H(s) = 1, determine the transfer function for each of the following cases: 


a. K=7 
b. K=16 
c. K=80 


>> H = tf(1l, 1); K = 7; G= tf£([0 0 K], [1 8 0]); 
>> disp(['(a) K = ',num2str(K)]); TFa = feedback (G,H) 
(a) K = 7 


Transfer function: 


s*2 +8 s+ 7 


Thus, H,(s) = 7/s? + 8s + 7). 


>> H = tf(1, 1); K = 16; G=tf([0 0 K], [1 8 0]); 
>> disp(['(b) K = ',num2str(K)]); TFa = feedback (G,H) 
(b) K = 16 


Transfer function: 
16 


a“2 4+ 68 es + 16 
Thus, Hp(s) = 16/(s* + 8s+ 16). 


>> H = tf£(1, 1); K = 80; G = t£([0 O Kj, [1 8 0]); 
>> disp(['(c) K = ',num2str(K)]); TFa = feedback (G,H) 
(c) K = 80 


Transfer function: 
80 


s*2 + 8 s + 80 


Thus, H,(s) = 80/(s? + 8s + 80). 


4.6 SYSTEM REALIZATION 


We now develop a systematic method for realization (or implementation) of an arbitrary Nth-order transfer function. The most general transfer 
function with M = N is given by 


= bos® +b,s*-! T° + by_is + by 


H(s) = ———_— (4.60) 
s” + as' +++ $aniiS + an 


Since realization is basically a synthesis problem, there is no unique way of realizing a system. A given transfer function can be realized in many 
different ways. A transfer function H(s) can be realized by using integrators or differentiators along with adders and multipliers. We avoid use of 
differentiators for practical reasons discussed in Sections 2.1 and 4.3-2. Hence, in our implementation, we shall use integrators along with scalar 
multipliers and adders. We are already familiar with representation of all these elements except the integrator. The integrator can be represented by a 
box with integral sign (time-domain representation, Fig. 4.19a) or by a box with transfer function 1/s (frequency-domain representation, 4.19b). 


fa) {b) 


Figure 4.19: (a) Time-domain and (b) frequency-domain representations of an integrator. 


4.6-1 Direct Form | Realization 


Rather than realize the general Nth-order system described by Eq. (4.60), we begin with a specific case of the following third-order system and then 
extend the results to the Nth-order case 


_ bs tbhsttbstb, + Stats 


H(s) = = =a 4.61 
38 + ays? + a)5 + a5 ye. WR ¢ ) 


We can express H (s) as 


s* Ss 


b b, ft 1 
H(s) = ( + = + oa + >) “ti; Grands. (4.62) 
4 1+ 


Ayis) 
Hsia) 


We can realize H(s) as a cascade of transfer function H;(s) followed by H2(s), as depicted in Fig. 4.20a, where the output of H;(s) is denoted by 
W(s). Because of the commutative property of LTI system transfer functions in cascade, we can also realize H(s) as a cascade of H2(s) followed by 
H4(s), as illustrated in Fig. 4.20b, where the (intermediate) output of H2(s) is denoted by V(s). 


Xs) | ee Wis) g X(s) | eee Vis) oe = Yis) 


oe 8=«Y(s) 
a ee ee 


(a) (b) 


Figure 4.20: Realization of a transfer function in two steps. 


The output of H4(s) in Fig. 4.20a is given by W(s) = H4(s)X(s). Hence 


b by b 
W(s) = (0 +—+—+ 3) X(s) (4.63) 
5s s* AY 


Also, the output Y(s) and the input W(s) of Ho(s) in Fig. 4.20a are related by Y(s) = H2(s)W(s). Hence 
a a) a 
W(s) = (1494945) Y(s) (4.64) 


We shall first realize H4(s). Equation (4.63) shows that the output W(s) can be synthesized by adding the input by X(s) to b;(X(s)/s), bo(X(s)/s?), 


and b3(X(s)/s°). Because the transfer function of an integrator is 1/s, the signals X(s)/s, X(s)/s?, and X(s)/s? can be obtained by successive 


integration of the input x(t). The left-half section of Fig. 4.21a shows how W(s) can be synthesized from X(s), according to Eq. (4.63). Hence, this 
section represents a realization of H4(s). 
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Figure 4.21: Direct form | realization of an LTIC system: (a) third-order and (b) Nth-order. 


To complete the picture, we shall realize H2(s), which is specified by Eq. (4.64). We can rearrange Eq. (4.64) as 
a a a 
¥(s) = W(s) — (* + +s + =) Y(s) (4.65) 


Hence, to obtain Y(s), we subtract a4 Y(s)/s, a2 Y¥(s)/s?, and a3 Y¥(s)/s? from W(s). We have already obtained W(s) from the first step [output of 
H4(s)]. To obtain signals Y(s)/s, Y(s)/s?, and Y(s)/s*, we assume that we already have the desired output Y(s). Successive integration of Y(s) yields 


the needed signals Y(s)/s, Y(s)/s?, and Y¥(s)is®. We now synthesize the final output Y(s) according to Eq. (4.65), as seen in the right-half section of 
Fig. 4.21a.[T] The left-half section in Fig. 4.21a represents H(s) and the right-half is H2(s). We can generalize this procedure, known as the direct 
form | (DFl) realization, for any value of N. This procedure requires 2N integrators to realize an Nth-order transfer function, as shown in Fig. 4.21b. 


4.6-2 Direct Form II Realization 
In the direct form I, we realize H(s) by implementing H1(s) followed by H2(s), as shown in Fig. 4.20a. We can also realize H(s), as shown in Fig. 


4.20b, where H9(s) is followed by H4(s). This procedure is known as the direct form II realization. Figure 4.22a shows direct form II realization, where 
we have interchanged sections representing H;(s) and H2(s) in Fig. 4.21b. The output of H2(s) in this case is denoted by V(s){7] 
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Figure 4.22: Direct form II realization of an Nth-order LTIC system. 


An interesting observation in Fig. 4.22a is that the input signal to both the chains of integrators is V(s). Clearly, the outputs of integrators in the left- 
side chain are identical to the corresponding outputs of the right-side integrator chain, thus making the right-side chain redundant. We can eliminate 
this chain and obtain the required signals from the left-side chain, as shown in Fig. 4.22b. This implementation halves the number of integrators to N, 
and, thus, is more efficient in hardware utilization than either Fig. 4.21b or 4.22a. This is the direct form II (DFIl) realization. 


An Nth-order differential equation with N = M has a property that its implementation requires a minimum of N integrators. A realization is canonic if 
the number of integrators used in the realization is equal to the order of the transfer function realized. Thus, canonic realization has no redundant 
integrators. The DFIl form in Fig. 4.22b is a canonic realization, and is also called the direct canonic form. Note that the DFI is noncanonic. 


The direct form | realization (Fig. 4.21b) implements zeros first [the left-half section represented by H1(s)] followed by realization of poles [the right- 
half section represented by H(s)] of H(s). In contrast, canonic direct implements poles first followed by zeros. Although both these realizations result 
in the same transfer function, they generally behave differently from the viewpoint of sensitivity to parameter variations. 


EXAMPLE 4.19 


Find the canonic direct form realization of the following transfer functions: 


a. 


All four of these transfer functions are special cases of H(s) in Eq. (4.60). 


a. The transfer function 5/(s + 7) is of the first order (N = 1); therefore, we need only one integrator for its realization. The feedback and 
feedforward coefficients are 


a=7 and b=0, Bb =5 


The realization is depicted in Fig. 4.23a. Because N = 1, there is a single feedback connection from the output of the integrator to the 
input adder with coefficient a, = 7. For N = 1, generally, there are N + 1 = 2 feedforward connections. However, in this case, bg = 0, 
and there is only one feedforward connection with coefficient b; = 5 from the output of the integrator to the output adder. Because there 
is only one input signal to the output adder, we can do away with the adder, as shown in Fig. 4.23a. 


Xt) Yis) 


Figure 4.23: Realization of H(s). 


RY 
H(s) = —— 
b. (s) s+7 


In this first-order transfer function, b, = 0. The realization is shown in Fig. 4.23b. Because there is only one signal to be added at the 
output adder, we can discard the adder. 


gs+5 
H(s) = —— 
C. (s) s+7 


The realization appears in Fig. 4.23c. Here H(s) is a first-order transfer function with a, = 7 and bg = 1, by = 5. There is a single 
feedback connection (with coefficient 7) from the integrator output to the input adder. There are two feedforward connections (Fig. 
4.23c) [1] 
His) 4s + 28 
= ————— 
d. s?+6s +5 


This is a second-order system with bo = 0, by = 4, bo = 28, a, = 6, and ag = 5. Figure 4.23d shows a realization with two feedback connections and 
two feedforward connections. 


EXERCISE E4.10 


Give canonic direct realization of 


2s 
H(s) = ———— 
(s) s+ 6s +25 


4.6-3 Cascade and Parallel Realizations 


An Nth-order transfer function H(s) can be expressed as a product or a sum of N first-order transfer functions. Accordingly, we can also realize H(s) 
as a cascade (series) or parallel form of these WN first-order transfer functions. Consider, for instance, the transfer function in part (d) of the Example 


4.19. 
4s + 28 

H(s) = 

s?+6s4+5 
We can express H(s) as 

4s + 28 4s +28 l 
H(s) = ———— = | ——_ ] | -—> 4. 
w (s +1)(s +5) oe \() ew 
—S—" 


he) is) 


We can also express H(s) as a sum of partial fractions as 


H(s) = ————_- = — - ——_ (4.66b) 


Hye) Hals) 


Equations (4.66) give us the option of realizing H(s) as a cascade of H;(s) and H2(s), as shown in Fig. 4.24a, or a parallel of H3(s) and H,(s), as 


depicted in Fig. 4.24b. Each of the first-order transfer functions in Fig. 4.24 can be implemented by using canonic direct realizations, discussed 
earlier. 


fa (b) 


Figure 4.24: Realization of (4s + 28)/((s + 1)(s + 5)): (a) cascade form and (b) parallel form. 


This discussion by no means exhausts all the possibilities. In the cascade form alone, there are different ways of grouping the factors in the 
numerator and the denominator of H(s), and each grouping can be realized in DFI or canonic direct form. Accordingly, several cascade forms are 
possible. In Section 4.6-4, we shall discuss yet another form that essentially doubles the numbers of realizations discussed so far. 


From a practical viewpoint, parallel and cascade forms are preferable because parallel and certain cascade forms are numerically less sensitive than 
canonic direct form to small parameter variations in the system. Qualitatively, this difference can be explained by the fact that in a canonic realization 
all the coefficients interact with each other, and a change in any coefficient will be magnified through its repeated influence from feedback and 
feedforward connections. In a parallel realization, in contrast, the change in a coefficient will affect only a localized segment; the case with a cascade 
realization is similar. 


In the examples of cascade and parallel realization, we have separated H(s) into first-order factors. For H(s) of higher orders, we could group H(s) 
into factors, not all of which are necessarily of the first order. For example, if H(s) is a third-order transfer function, we could realize this function as a 
cascade (or a parallel) combination of a first-order and a second-order factor. 


REALIZATION OF COMPLEX 
CONJUGATE POLES 


The complex poles in H(s) should be realized as a second-order (quadratic) factor because we cannot implement multiplication by complex numbers. 
Consider, for example, 


H(s) = 10s + 50 
(s + 3)(s? +45 + 13) 
10s + 50 
~ (s +35 +2—f3e +2473) 
2 1+ j2 1 ~¥2 


S+3 s+2-—jf3 s+2+/ 3 
We cannot realize first-order transfer functions individually with the poles —2 + j/3 because they require multiplication by complex numbers in the 


feedback and the feedforward paths. Therefore, we need to combine the conjugate poles and realize them as a second-order transfer function.[T] In 
the present case, we can express H(s) as 


10 s+5 
ahd dane (=) eas nm 


25-8 
$43 $2444 13 


Now we can realize H(s) in cascade form by using Eq. (4.67a) or in parallel form by using Eq. (4.67b). 


nN 


(4.67b) 


REALIZATION OF REPEATED POLES 
When repeated poles occur, the procedure for canonic and cascade realization is exactly the same as before. In parallel realization, however, the 
procedure requires special handling, as explained in Example 4.20. 


EXAMPLE 4.20 
Determine the parallel realization of 


7s? +375 +51 
H(s) = ———__——- 
‘s) (s + 2)(s + 3)? 
5 2 3 


740 F458 GaP 


This third-order transfer function should require no more than three integrators. But if we try to realize each of the three partial fractions separately, 
we require four integrators because of the one second-order term. This difficulty can be avoided by observing that the terms 1 / (s + 3) and 1/(s + 
3) can be realized with a cascade of two subsystems, each having a transfer function 1 / (s + 3), as shown in Fig. 4.25. Each of the three first- 
order transfer functions in Fig. 4.25 may now be realized as in Fig. 4.23. 
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Figure 4.25: Parallel realization of (7s + 37s + 51)/((s + 2)(s + 3)). 


EXERCISE E4.11 


Find the canonic, cascade, and parallel realization of 


s+3 s+3 1 
H(s) = ————_——_ = | —_ gi 
$2? +-7s+10 s+2 s+5 


4.6-4 Transposed Realization 


Two realizations are said to be equivalent if they have the same transfer function. A simple way to generate an equivalent realization from a given 
realization is to use its transpose. To generate a transpose of any realization, we change the given realization as follows: 


1. Reverse all the arrow directions without changing the scalar multiplier values. 
2. Replace pickoff nodes by adders and vice versa. 
3. Replace the input X(s) with the output Y(s) and vice versa. 


Figure 4.26a shows the transposed version of the canonic direct form realization in Fig. 4.22b found according to the rules just listed. Figure 4.26b is 
Fig. 4.26a reoriented in the conventional form so that the input X(s) appears at the left and the output Y(s) appears at the right. Observe that this 
realization is also canonic. 


Yis) by 


Figure 4.26: Realization of an Nth-order LTI transfer function in the transposed form. 


Rather than prove the theorem on equivalence of the transposed realizations, we shall verify that the transfer function of the realization in Fig. 4.26b 
is identical to that in Eq. (4.60). 


Figure 4.26b shows that Y(s) is being fed back through N paths. The fed-back signal appearing at the input of the top adder is 


i. 4 —ay-1 , —4&n 
(A+ Bat val 1) Y(5) 


The signal X(s), fed to the top adder through N + 1 forward paths, contributes 


b by. . By 
(+ te A 4 OH) X(s) 


gN-1 s? 
The output Y(s) is equal to the sum of these two signals (feed forward and feed back). Hence 


—a —a —ay— —Aan 
¥(s)= (“+ Pat ee ) ys) 


g2 gN-1 gh 
b by. , d 
+ (+24 $a + at) x6) 
§ § 


Transporting all the Y(s) terms to the left side and multiplying throughout by s\ we obtain 
(s¥ + ais*—! +--+ + awis + aw)¥(s) = (bos™ + bis®—! + +--+ bys + bw) X(8) 


Consequently 
Hs) = Y(s) bos™ + bys¥-! + --- + by_is + by 
~ X(s) s% +ays¥-! +--- + @w_is + Gy 


Hence, the transfer function H(s) is identical to that in Eq. (4.60). 


We have essentially doubled the number of possible realizations. Every realization that was found earlier has a transpose. Note that the transpose of 
a transpose results in the same realization. 


EXAMPLE 4.21 
Find the transpose of the canonic direct realization found in parts (a) and (d) of Example 4.19 (Fig. 4.23c and 4.23d). 


The transfer functions are 


a. 


s+5 
s+7 


4s + 28 
s?+65 45 


Both these realizations are special cases of the one in Fig. 4.26b. 


a. In this case, N = 1 with a; = 7, bp = 1, by = 5. The desired realization can be obtained by transposing Fig. 4.23c. However, we already 


have the general model of the transposed realization in Fig. 4.26b. The desired solution is a special case of Fig. 4.26b with N = 1 and 
a, =7, bo = 1, by = 5, as shown in Fig. 4.27a. 


Yis) 


(a) (b) 
Figure 4.27: Transposed form realization of (a) (s + 5)/(s + 7) and (b) (4s + 28)/(s* + 6s + 5). 


b. In this case N = 2 with bo = 0, by = 4, bo = 28, a; = 6, ag = 5. Using the model of Fig. 4.26b, we obtain the desired realization, as 
shown in Fig. 4.27b. 


EXERCISE E4.12 
Find the realization that is the transposed version of (a) DFI realization and (b) canonic direct realization of H(s) in Exercise E4.10. 


4.6-5 Using Operational Amplifiers for System Realization 


In this section, we discuss practical implementation of the realizations described in Section 4.6-4. Earlier we saw that the basic elements required for 
the synthesis of an LTIC system (or a given transfer function) are (scalar) multipliers, integrators, and adders. All these elements can be realized by 
operational amplifier (op-amp) circuits. 


OPERATIONAL AMPLIFIER CIRCUITS 

Figure 4.28 shows an op-amp circuit in the frequency domain (the transformed circuit). Because the input impedance of the op amp is infinite (very 
high), all the current / (s) flows in the feedback path, as illustrated. Moreover V,(s), the voltage at the input of the op amp, is zero (very small) 
because of the infinite (very large) gain of the op amp. Therefore, for all practical purposes, 


Y(s) = —I(s)Z;(s) 


Moreover, because v, = 0, 
X{s) 
l()=>— 
Z(s) 
Substitution of the second equation in the first yields 
Z (8) 
Y(s) = ———X(s) 
Z(s) 


Therefore, the op-amp circuit in Fig. 4.28 has the transfer function 


Z;(S) 


H(s)=-— (4.68) 


Z(s) 


Figure 4.28: A basic inverting configuration op-amp circuit. 
By properly choosing Z(s) and Z;(s), we can obtain a variety of transfer functions, as the following development shows. 


THE SCALAR MULTIPLIER 
If we use a resistor Ry in the feedback and a resistor R at the input (Fig. 4.29a), then Z;(s) = Rr, Z(s) = R, and 


R 
H(s) = -—£ (4.69a) 


a  f ee 
R, 
dae Te 
Fis) k Ys) 
o_o 7 —-e 


ib 


Figure 4.29: (a) Op-amp inverting amplifier. (b) Integrator. 


The system acts as a scalar multiplier (or an amplifier) with a negative gain R;/R. A positive gain can be obtained by using two such multipliers in 


cascade or by using a single noninverting amplifier, as depicted in Fig. 4.16c. Figure 4.29a also shows the compact symbol used in circuit diagrams 
for a scalar multiplier. 


THE INTEGRATOR 
If we use a capacitor C in the feedback and a resistor R at the input (Fig. 4.29b), then Z;(s) = 1/Cgs, Z(s) = R, and 


H(s) = (-z2)- (4.69b) 


The system acts as an ideal integrator with a gain —1/RC. Figure 4.29b also shows the compact symbol used in circuit diagrams for an integrator. 


THE ADDER 

Consider now the circuit in Fig. 4.30a with r inputs X4(s), X2(s),..., X;/(s). AS usual, the input voltage V,(s) = 0 because the gain of op amp — o. 

Moreover, the current going into the op amp is very small (~0) because the input impedance — oo. Therefore, the total current in the feedback 

resistor Ry is 14(s) + I2(s) +...+ /(s). Moreover, because V,(s) = 0, 

Xj(s) 

: j\ . 

i(s)=—— Jw l 20005 F 
j 


i» ib 


Figure 4.30: Op-amp summing and amplifying circuit. 
Also 


Y(s) = —Ry[h(s) + hs) +--- + L(8)] 
R R R 
- Rx) t Rw) fees XW) 


= ky X\(S) + 2 X2(8) + +++ +k X,(S) (4.70) 
where 
hee 

1 R; 
Clearly, the circuit in Fig. 4.30 serves a adder and an amplifier with any desired gain for each of the input signals. Figure 4.30b shows the compact 
symbol used in circuit diagrams for a adder with r inputs. 


EXAMPLE 4.22 
Use op-amp circuits to realize the canonic direct form of the transfer function 
25 +5 
H(s) = = 
s*-+4s +10 
The basic canonic realization is shown in Fig. 4.31a. The same realization with horizontal reorientation is shown in Fig. 4.31b. Signals at various 
points are also indicated in the realization. For convenience, we denote the output of the last integrator by W(s). Consequently, the signals at the 


inputs of the two integrators are sW(s) and s? Ws), as shown in Fig. 4.31a and 4.31b. Op-amp elements (multipliers, integrators, and adders) 
change the polarity of the output signals. To incorporate this fact, we modify the canonic realization in Fig. 4.31b to that depicted in Fig. 4.31c. In Fig. 


4.31b, the successive outputs of the adder and the integrators are s@ Ws), sW(s), and W(s) respectively. Because of polarity reversals in opamp 


circuits, these outputs are —s? W(s), sW(s), and —W(s), respectively, in Fig. 4.31c. This polarity reversal requires corresponding modifications in the 
signs of feedback and feedforward gains. According to Fig. 4.31b 


s?>W(s) = X(s) —4sW(s) — 10W(s) 


1ookt 


oko 


100k 


woun 
A 


Figure 4.31: Op-amp realization of a second-order transfer function (2s + 5)/(s2 + 4s + 10). 


Therefore 


—s*W(s) = —X(s) +4sW(s) + 10W(s) 


Because the adder gains are always negative (see Fig. 4.30b), we rewrite the foregoing equation as 
—s’W(s) = —1[X(s)] — 4[-s W(s)] — 10[-W(s)] 


Figure 4.31c shows the implementation of this equation. The hardware realization appears in Fig. 4.31d. Both integrators have a unity gain which 
requires RC = 1. We have used R = 100 kQ and C = 10 uF. The gain of 10 in the outer feedback path is obtained in the adder by choosing the 
feedback resistor of the adder to be 100 kQ and an input resistor of 10 kQ. Similarly, the gain of 4 in the inner feedback path is obtained by using 
the corresponding input resistor of 25 kKQ. The gains of 2 and 5, required in the feedforward connections, are obtained by using a feedback resistor of 


100 kQ and input resistors of 50 and 20 kQ, respectively [1] 


The op-amp realization in Fig. 4.31 is not necessarily the one that uses the fewest op amps. This example is given just to illustrate a systematic 
procedure for designing an op-amp circuit of an arbitrary transfer function. There are more efficient circuits (such as Sallen-Key or biquad) that use 
fewer op amp to realize a second-order transfer function. 


EXERCISE E4.13 
Show that the transfer functions of the op-amp circuits in Fig. 4.32a and 4.32b are H(s) and H2(s), respectively, where 


—R a 1 
Hs) = SL (—2) a= : 
S+a Ry/Cy 


Hs) = =< (=**) a= I b= 
f 


S+a RyCy RC 


Figure 4.32 


(tit may seem odd that we first assumed the existence of Y(s), integrated it successively, and then in turn generated Y(s) from W(s) and the three 


successive integrals of signal Y(s). This procedure poses a dilemma similar to "Which came first, the chicken or the egg?" The problem here is 
satisfactorily resolved by writing the expression for Y(s) at the output of the right-hand adder (at the top) in Fig. 4.21a and verifying that this 
expression is indeed the same as Eq. (4.64). 


[tlThe reader can show that the equations relating X(s), V(s), and Y(s) in Fig. 4.22a are 


ay ay ay 
V(s) = X(s) — (+ 5 or $4) Vis) 
s 5° s 


hy b, by 
Y(s)= (m+ 2+ +--+) v0) 
s . s 


and 


b b i 
Ys) = (m+ +4. +t) ve 
ee s' 


[tlWhen M = N (as in this case), H(s) can also be realized in another way by recognizing that 


2 
H(s) = 1- —~ 
ts) s+7 


We now realize H(s) as a parallel combination of two transfer functions, as indicated by this equation. 


[tl\t is possible to realize complex, conjugate poles indirectly by using a cascade of two first-order transfer functions and feedback. A transfer 
function with poles — a +/b can be realized by using a cascade of two identical first-order transfer functions, each having a pole at —a. (See Prob. 
4.6-13.) 


[tit is possible to avoid the two inverting op amps (with gain —1) in Fig. 4.31d by adding signal sW(s) to the input and output adders directly, using 
the noninverting amplifier configuration in Fig. 4.16d. 


4.7 APPLICATION TO FEEDBACK AND CONTROLS 


Generally, systems are designed to produce a desired output y(t) for a given input x(t). Using the given performance criteria, we can design a 
system, as shown in Fig. 4.33a. Ideally, such an open-loop system should yield the desired output. In practice, however, the system characteristics 
change with time, as a result of aging or replacement of some components or because of changes in the environment in which the system is 
operating. Such variations cause changes in the output for the same input. Clearly, this is undesirable in precision systems. 


x(f) y(t) 
en G(s) ———— 


(a) 


x(t) e(t) y() 
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(b) 
Figure 4.33: (a) Open-loop and (b) closed-loop (feedback) systems. 


A possible solution to this problem is to add a signal component to the input that is not a predetermined function of time but will change to counteract 
the effects of changing system characteristics and the environment. In short, we must provide a correction at the system input to account for the 
undesired changes just mentioned. Yet since these changes are generally unpredictable, it is not clear how to preprogram appropriate corrections to 
the input. However, the difference between the actual output and the desired output gives an indication of the suitable correction to be applied to the 
system input. It may be possible to counteract the variations by feeding the output (or some function of output) back to the input. 


We unconsciously apply this principle in daily life. Consider an example of marketing a certain product. The optimum price of the product is the value 
that maximizes the profit of a merchant. The output in this case is the profit, and the input is the price of the item. The output (profit) can be 
controlled (within limits) by varying the input (price). The merchant may price the product too high initially, in which case, he will sell too few items, 
reducing the profit. Using feedback of the profit (output), he adjusts the price (input), to maximize his profit. If there is a sudden or unexpected 
change in the business environment, such as a strike-imposed shutdown of a large factory in town, the demand for the item goes down, thus 
reducing his output (profit). He adjusts his input (reduces price) using the feedback of the output (profit) in a way that will optimize his profit in the 
changed circumstances. If the town suddenly becomes more prosperous because of a new factory opens, he will increase the price to maximize the 
profit. Thus, by continuous feedback of the output to the input, he realizes his goal of maximum profit (optimum output) in any given circumstances. 
We observe thousands of examples of feedback systems around us in everyday life. Most social, economical, educational, and political processes 


are, in fact, feedback processes. A block diagram of such a system, called the feedback or closed-loop system is shown in Fig. 4.33b. 


A feedback system can address the problems arising because of unwanted disturbances such as random-noise signals in electronic systems, a gust 
of wind affecting a tracking antenna, a meteorite hitting a spacecraft, and the rolling motion of antiaircraft gun platforms mounted on ships or moving 
tanks. Feedback may also be used to reduce nonlinearities in a system or to control its rise time (or bandwidth). Feedback is used to achieve, with a 
given system, the desired objective within a given tolerance, despite partial ignorance of the system and the environment. A feedback system, thus, 
has an ability for supervision and self-correction in the face of changes in the system parameters and external disturbances (change in the 
environment). 


Consider the feedback amplifier in Fig. 4.34. Let the forward amplifier gain G = 10,000. One-hundredth of the output is fed back to the input (H = 
0.01). The gain T of the feedback amplifier is obtained by [see Eq. (4.59)] 


~ 1+GH 14100 


x(t) e(t) y(t) 
—_ > ae 


H 


Figure 4.34: Effects of negative and positive feedback. 


Suppose that because of aging or replacement of some transistors, the gain G of the forward amplifier changes from 10,000 to 20,000. The new gain 
of the feedback amplifier is given by 


G 20,000 
- = = 99.5 
1+GH 14200 


Surprisingly, 100% variation in the forward gain G causes only 0.5% variation in the feedback amplifier gain 7. Such reduced sensitivity to parameter 
variations is a must in precision amplifiers. In this example, we reduced the sensitivity of gain to parameter variations at the cost of forward gain, 
which is reduced from 10,000 to 99. There is no dearth of forward gain (obtained by cascading stages). But low sensitivity is extremely precious in 
precision systems. 


Now, consider what happens when we add (instead of subtract) the signal fed back to the input. Such addition means the sign on the feedback 
connection is + instead of — (which is same as changing the sign of H in Fig. 4.34). Consequently 


G 
T= —— 
1—GH 
If we let G = 10,000 as before and H = 0.9 x 1074, then 
10,000 
T = —————_——_ = 100,000 


1 — 0.9(104)(10-*) 


Suppose that because of aging or replacement of some transistors, the gain of the forward amplifier changes to 11,000. The new gain of the 
feedback amplifier is 


*. 1,000 
~ 1—0.9(11,000)(10-4) 


Observe that in this case, a mere 10% increase in the forward gain G caused 1000% increase in the gain T (from 100,000 to 1,100,000). Clearly, 
the amplifier is very sensitive to parameter variations. This behavior is exactly opposite of what was observed earlier, when the signal fed back was 
subtracted from the input. 


= 1,100,000 


What is the difference between the two situations? Crudely speaking, the former case is called the negative feedback and the latter is the positive 
feedback. The positive feedback increases system gain but tends to make the system more sensitive to parameter variations. It can also lead to 
instability. In our example, if G were to be 111,111, then GH = 1, T= «, and the system would become unstable because the signal fed back was 
exactly equal to the input signal itself, since GH = 1. Hence, once a signal has been applied, no matter how small and how short in duration, it comes 
back to reinforce the input undiminished, which further passes to the output, and is fed back again and again and again. In essence, the signal 
perpetuates itself forever. This perpetuation, even when the input ceases to exist, is precisely the symptom of instability. 


Generally speaking, a feedback system cannot be described in black and white terms, such as positive or negative. Usually H is a frequency- 
dependent component, more accurately represented by H(s), varies with frequency. Consequently, what was negative feedback at lower frequencies 
can turn into positive feedback at higher frequencies and may give rise to instability. This is one of the serious aspects of feedback systems, which 
warrants careful attention of a designer. 


4.7-1 Analysis of a Simple Control System 


Figure 4.35a represents an automatic position control system, which can be used to control the angular position of a heavy object (e.g., a tracking 
antenna, an antiaircraft gun mount, or the position of a ship). The input 0; is the desired angular position of the object, which can be set at any given 


value. The actual angular position 8, of the object (the output) is measured by a potentiometer whose wiper is mounted on the output shaft. The 
difference between the input 0; (set at the desired output position) and the output 6, (actual position) is amplified; the amplified output, which is 
proportional to 8; — Qo, is applied to the motor input. If 6; — 8, = 0 (the output being equal to the desired angle), there is no input to the motor, and 
the motor stops. But if 8, * @;, there will be a nonzero input to the motor, which will turn the shaft until 8, = ;. It is evident that by setting the input 


potentiometer at a desired position in this system, we can control the angular position of a heavy remote object. 
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Figure 4.35: (a) An automatic position control system. (b) Its block diagram. (c) The unit step response. (d) The unit ramp 
response. 


The block diagram of this system is shown in Fig. 4.35b. The amplifier gain is K, where K is adjustable. Let the motor (with load) transfer function 
that relates the output angle 0, to the motor input voltage be G(s) [see Eq. (1.77)]. This feedback arrangement is identical to that in Fig. 4.18d with 
H(s) = 1. Hence, 7T(s), the (closed-loop) system transfer function relating the output 6, to the input @,, is 


O(s) _ bie KG(s) 
Oi(s) ~ 14+ KG(s) 


From this equation, we shall investigate the behavior of the automatic position control system in Fig. 4.35a for a step and a ramp input. 


STEP INPUT 

If we desire to change the angular position of the object instantaneously, we need to apply a step input. We may then want to know how long the 
system takes to position itself at the desired angle, whether it reaches the desired angle, and whether it reaches the desired position smoothly 
(monotonically) or oscillates about the final position. If the system oscillates, we may want to know how long it takes for the oscillations to settle 
down. All these questions can be readily answered by finding the output 8,(t) when the input 6;(t) = u(t). A step input implies instantaneous change 


in the angle. This input would be one of the most difficult to follow; if the system can perform well for this input, it is likely to give a good account of 
itself under most other expected situations. This is why we test control systems for a step input. 


For the step input 6,(t) = u(t), 6;(s) = 1/s and 
KG(s) 
s[1+ KG(s)] 


Let the motor (with load) transfer function relating the load angle 9,(t) to the motor input voltage be G(s) = 1/(s(s + 8)) [see Eq. (1.77)]. This yields 
K 


s(s +8) a K 
| s(s? +85 +K) 


1 
0,(s) = -T(s) = 
s 


0,(s) = 
s}l+——_— 
s(s +8) 


Let us investigate the system behavior for three different values of gain K. 


For K=7, 
ee ee a 
s(s?+854+7) s(s+I(s+7) ss stl 547 


O,(s )= 


and 


0,(t) = (1 — Ze? + te”) u(t) 


This response, illustrated in Fig. 4.35c, shows that the system reaches the desired angle, but at a rather leisurely pace. To speed up the response let 
us increase the gain to, say, 80. 


For K = 80, 


80 80 
O,(s )= 


s(s? +85 +80) s(s+4—j8)(s+4 +4 j8) 


1 m 25 @i153* ; 3 @- 1153" 
Ss S$+4—-j8 s+4+ /8 
and 


0) = E os Be-Ht cos (81 + 153°)] u(t) 


This response, also depicted in Fig. 4.35c, achieves the goal of reaching the final position at a faster rate than that in the earlier case (K = 7). 
Unfortunately the improvement is achieved at the cost of ringing (oscillations) with high overshoot. In the present case the percent overshoot (PO) is 
21%. The response reaches its peak value at peak time tp = 0.393 second. The rise time, defined as the time required for the response to rise from 


10% to 90% of its steady-state value, indicates the speed of response.!T] In the present case tp = 0.175 second. The steady-state value of the 


response is unity so that the steady-state error is zero. Theoretically it takes infinite time for the response to reach the desired value of unity. In 
practice, however, we may consider the response to have settled to the final value if it closely approaches the final value. A widely accepted measure 
of closeness is within 2% of the final value. The time required for the response to reach and stay within 2% of the final value is called the settling 


time t 5.4] In Fig. 4.35c, we find ts; = 1 second (when K = 80). A good system has a small overshoot, small t-; and ts and a small steady-state error. 


A large overshoot, as in the present case, may be unacceptable in many applications. Let us try to determine K (the gain) that yields the fastest 
response without oscillations. Complex characteristic roots lead to oscillations; to avoid oscillations, the characteristic roots should be real. In the 


present case the characteristic polynomial is s?+8s+K. For K > 16, the characteristic roots are complex; for K < 16, the roots are real. The fastest 
response without oscillations is obtained by choosing K = 16. We now consider this case. 


For K = 16, 
16 16 
0,(5) SS SS ee 
s(s*>+85+16) s(s +4)? 
1 1 4 


s s+4 (s+4y 
and 
@,(t) =[1 — (4t + De Jus) 
This response also appears in Fig. 4.35c. The system with K > 16 is said to be underdamped (oscillatory response), whereas the system with K < 16 


is said to be overdamped. For K = 16, the system is said to be critically damped. 


There is a trade-off between undesirable overshoot and rise time. Reducing overshoots leads to higher rise time (sluggish system). In practice, a 
small overshoot, which is still faster than the critical damping, may be acceptable. Note that percent overshoot PO and peak time ft, are meaningless 


for the overdamped or critically damped cases. In addition to adjusting gain K, we may need to augment the system with some type of compensator 
if the specifications on overshoot and the speed of response are too stringent. 


RAMP INPUT 
If the antiaircraft gun in Fig. 4.35a is tracking an enemy plane moving with a uniform velocity, the gun-position angle must increase linearly with f. 
Hence, the input in this case is a ramp; that is, 0,(t) = tu(t). Let us find the response of the system to this input when K = 80. In this case, 8;(s) = 


1/s?, and 


80 0.1 I O.1(s —2 
O,(s) = i is 
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Use of Table 4.1 yields 

@,(t) = [—0.1 + 4 + te-* cos (8t + 36.87°)] u(t) 


This response, sketched in Fig. 4.35d, shows that there is a steady-state error e, = 0.1 radian. In many cases such a small steady-state error may 


be tolerable. If, however, a zero steady-state error to a ramp input is required, this system in its present form is unsatisfactory. We must add some 
form of compensator to the system. 


COMPUTER EXAMPLE C4.4 
Using the feedback system of Fig. 4.18d with G(s) = K/(s(s + 8)) and H(s) = 1, determine the step response for each of the following cases: 


a. K=7 
b. K=16 
c. K=80 


Additionally, 
d. Find the unit ramp response when K = 80. 


Computer Example C4.3 computes the transfer functions of these feedback systems in a simple way. In this example, the conv command is used to 
demonstrate polynomial multiplication of the two denominator factors of G(s). Step responses are computed by using the step command. 


(a-c) 


>> H = tf(1,1); K = 7; G= tf([0 0 K], conv([O0 1 0], [0 1 8])); 
>> TFa = feedback(G, H); 

>> H = tf(1,1); K = 16; G = tf([0 0 K]. conv([O0 1 0], [0 1 8])); 
>> TFb = feeback (G,H); 

>> H = tf(1,1); K = 80; G = tf([0 0 K]. conv([0 1 0], [0 1 8])); 
>> TFc = feeback (G,H); 

>> figure(1); clf; step(TFa, 'k-',TFb, 'k - ',TFc, 'k-. ") 
>> legend( '(a) K= 7 ', '(b) K = 16 ', ' (c) K = 80 ',0); 
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Figure C4.4-1 


The unit ramp response is equivalent to the derivative of the unit step response. 


>> TFd = series(TFc, tf([0 1], [1 0])); 
>> figure(2); clf; step(TFd, 'k-'); legend( '(d) k = 80 ', 0); 
>> title( 'Unit Ramp Response ') 
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Figure C4.4-2 


Design Specifications 


Now the reader has some idea of the various specifications a control system might require. Generally, a control system is designed to meet given 
transient specifications, steady-state error specifications, and sensitivity specifications. Transient specifications include overshoot, rise time, and 
settling time of the response to step input. The steady-state error is the difference between the desired response and the actual response to a test 
input in steady-state. The system should also satisfy a specified sensitivity specifications to some system parameter variations, or to certain 


disturbances. Above all, the system must remain stable under operating conditions. Discussion of design procedures used to realize given 
specifications is beyond the scope of this book. 


[tl Delay time tg, defined as the time required for the response to reach 50% of its steady-state value, is another indication of speed. For the present 
case, ty = 0.141 second. 


[t] Typical percentage values used are 2 to 5% for tg. 


4.8 FREQUENCY RESPONSE OF AN LTIC SYSTEM 


Filtering is an important area of signal processing. Filtering characteristics of a system are indicated by its response to sinusoids of various 


frequencies varying from 0 to co. Such characteristics are called the frequency response of the system. In this section, we shall find the frequency 
response of LTIC systems. 


In Section 2.4-4 we showed that an LTIC system response to an everlasting exponential input x(t) = e°! is also an everlasting exponential H(s)e*, 
As before, we use an arrow directed from the input to the output to represent an input -output pair: 


e" — > H(s)e" (4.71) 
Setting s = jw in this relationship yields 
el ==> H(jw)el (4.72) 


Noting that cos wt is the real part of elt use of Eq. (2.40) yields 


cos ot => Re[H (jo)e!] (4.73) 


We can express H(jw) in the polar form as 


H(j@) = |H (ja) \ei4#o (4.74) 

With this result, the relationship (4.73) becomes 

cos@t = > |H(jo)|cos [at + ZH(ja)] 

In other words, the system response y(t) to a sinusoidal input cos wt is given by 
y(t) = |HUo@)|cos[@t + £HUja@)] (4.75a) 


Using a similar argument, we can show that the system response to a sinusoid cos (wt + 8) is 


y(t) = |HUo@)| cos [ot +0 + ZH Uja)] (4.75b) 


This result is valid only for BIBO-stable systems. The frequency response is meaningless for BIBO-unstable systems. This follows from the fact that 
the frequency response in Eq. (4.72) is obtained by setting s = jw in Eq. (4.71). But, as shown in Section 2.4-4 [Eqs. (2.47) and (2.48)], the 
relationship (4.71) applies only for the values of s for which H(s) exists. For BIBO-unstable systems, the ROC for H(s) does not include the jw axis 


where s = jw [see Eq. (4.14)]. This means that H(s) when s = jw, is meaningless for BIBO-unstable systems. |T] 


Equation (4.75b) shows that for a sinusoidal input of radian frequency w, the system response is also a sinusoid of the same frequency w. The 
amplitude of the output sinusoid is |H(jw)| times the input amplitude, and the phase of the output sinusoid is shifted by ZH(ju.) with respect to the 
input phase (see later Fig. 4.36 in Example 4.23). For instance, a certain system with |H(/10)| = 3 and 2H(j10) = —30° amplifies a sinusoid of 
frequency w = 10 by a factor of 3 and delays its phase by 30°. The system response to an input 5 cos (10f + 50°) is 3 x 5 cos (10f + 50° — 30°) = 
15 cos (10f + 20°). 
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Figure 4.36: Frequency responses of the LTIC system. 


Clearly |H(juo)| is the amplitude gain of the system, and a plot of |H(jw)| versus w shows the amplitude gain as a function of frequency w. We shall 
call ZH(jw) the amplitude response. |t also goes under the name magnitude response in the literature. [4] Similarly, ZH(jw) is the phase response 
and a plot of 7H(jw) versus w shows how the system modifies or changes the phase of the input sinusoid. Observe that H(jw) has the information 
of |H(jw)| and 2 H(ju). For this reason, H(jw) is also called the frequency response of the system. The frequency response plots |H(jw)| and 
ZH(jw) show at a glance how a system responds to sinusoids of various frequencies. Thus, the frequency response of a system represents its 
filtering characteristic. 


EXAMPLE 4.23 _ 
Find the frequency response (amplitude and phase response) of a system whose transfer function is 


s+0.1 
s4+5 
Also, find the system response y(t) if the input x(t) is 


H(s) = 


a. cos 2t 


b. cos (10f — 50°) 


In this case 
ee: j o+0.1 
H(jo) = ——— 
Yo) jo } 5 
Therefore 


. Vw + 0.01 ,{@ ,(@ 
aes and £H(jm) = tan (=) — tan () 


Both the amplitude and the phase response are depicted in Fig. 4.36a as functions of w. These plots furnish the complete information about the 
frequency response of the system to sinusoidal inputs. 


a. For the input x(t) = cos 2t, w = 2, and 


J (2)* + 0.01 


A(j2)) = SS - = 0.372 
a JO +25 


2 ! 
£H(j2) =tan"! (=) —tan! (=) = 87.1° — 21.8° = 65.3° 
We also could have read these values directly from the frequency response plots in Fig. 4.36a corresponding to w = 2. This result 
means that for a sinusoidal input with frequency w = 2, the amplitude gain of the system is 0.372, and the phase shift is 65.3°. In other 
words, the output amplitude is 0.372 times the input amplitude, and the phase of the output is shifted with respect to that of the input 
by 65.3°. Therefore, the system response to an input cos 2t is 


y(t) = 0.372 cos (2t + 65.3°) 
The input cos 2t and the corresponding system response 0.372 cos (2¢ + 65.3°) are illustrated in Fig. 4.36b. 


b. For the input cos (10t — 50°), instead of computing the values |H(jw)| and 2H(jw) as in part (a), we shall read them directly from the 
frequency response plots in Fig. 4.36a corresponding to w = 10. These are: 


|H(j10)| = 0.894 and £H(j10) = 26° 


Therefore, for a sinusoidal input of frequency w = 10, the output sinusoid amplitude is 0.894 times the input amplitude, and the output 
sinusoid is shifted with respect to the input sinusoid by 26°. Therefore, y(t), the system response to an input cos (10f = 50°), is 


y(t) = 0.894 cos (101 — 50° + 26°) = 0.894 cos (101 — 24°) 
If the input were sin (10f — 50°), the response would be 0.894 sin (10f — 50° + 26°) = 0.894 sin (10t — 24°). 


The frequency response plots in Fig. 4.36a show that the system has highpass filtering characteristics; it responds well to sinusoids of 
higher frequencies (Ww well above 5), and suppresses sinusoids of lower frequencies (w well below 5). 


COMPUTER EXAMPLE C4.5 
Plot the frequency response of the transfer function H(s) = (s + 5)i(s? + 3s + 2). 


>> H= tf([1 5], [1 3 2]); 
>> bode(H, 'k-',{0.1 100}); 
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Figure C4.5 


EXAMPLE 4.24 


Find and sketch the frequency response (amplitude and phase response) for the following. 
a. an ideal delay of T seconds 
b. an ideal differentiator 


c. an ideal integrator 


a. Ideal delay of T seconds. The transfer function of an ideal delay is [see Eq. (4.46)] 
H(s) =e"? 
Therefore 
H(jo) =e i 
Consequently 
|H(ja)| =| and LH(ja) = —wT (4.76) 


These amplitude and phase responses are shown in Fig. 4.37a. The amplitude response is constant (unity) for all frequencies. The 
phase shift increases linearly with frequency with a slope of — T. This result can be explained physically by recognizing that if a sinusoid 
cos wt is passed through an ideal delay of T seconds, the output is cos w(t — 7). The output sinusoid amplitude is the same as that of 
the input for all values of w. Therefore, the amplitude response (gain) is unity for all frequencies. Moreover, the output cos w(t — 7) = 
cos (wt — w7) has a phase shift — wT with respect to the input cos wt. Therefore, the phase response is linearly proportional to the 
frequency w with a slope —T. 
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Figure 4.37: Frequency response of an ideal (a) delay, (b) differentiator, and (c) integrator. 


. An ideal differentiator. The transfer function of an ideal differentiator is [see Eq. (4.47)] 


Hisy=s 


Therefore 
° ° ig /> 
H (jo) = ja = @e’™'* 


Consequently 


|H(jw)| =@ and LH(j@) = (4.77) 


i) | 


This amplitude and phase response are depicted in Fig. 4.37b. The amplitude response increases linearly with frequency, and phase 
response is constant (11/2) for all frequencies. This result can be explained physically by recognizing that if a sinusoid cos wt is passed 
through an ideal differentiator, the output is —w sin wt = weos[ut + (11/2)]. Therefore, the output sinusoid amplitude is w times the 
input amplitude; that is, the amplitude response (gain) increases linearly with frequency w. Moreover, the output sinusoid undergoes a 
phase shift Tr/2 with respect to the input cos wt. Therefore, the phase response is constant (11/2) with frequency. 


In an ideal differentiator, the amplitude response (gain) is proportional to frequency [|H(jw)| = w], so that the higher-frequency 
components are enhanced (see Fig. 4.37b). All practical signals are contaminated with noise, which, by its nature, is a broadband 
(rapidly varying) signal containing components of very high frequencies. A differentiator can increase the noise disproportionately to the 
point of drowning out the desired signal. This is why ideal differentiators are avoided in practice. 


c. An ideal integrator. The transfer function of an ideal integrator is [see Eq. (4.48)] 
I 
H(s) = - 
AY 
Therefore 
l —j I say f' 
Cf) me re 
J@ @ @ 
Consequently 


1 
|H(jw)| = — and L£H(jo) = — (4.78) 
@ 


NIA 


These amplitude and the phase responses are illustrated in Fig. 4.37c. The amplitude response is inversely proportional to frequency, 
and the phase shift is constant (—t1r/2) with frequency. This result can be explained physically by recognizing that if a sinusoid cos uot is 
passed through an ideal integrator, the output is (1/w) sin wt = (1/w) cos [wt — (tTr/2)]. Therefore, the amplitude response is inversely 
proportional to w, and the phase response is constant (—11/2) with frequency.!t] Because its gain is 1/w, the ideal integrator 
suppresses higher-frequency components but enhances lower-frequency components with w < 1. Consequently, noise signals (if they 
do not contain an appreciable amount of very-low-frequency components) are suppressed (smoothed out) by an integrator. 


EXERCISE E4.14 


Find the response of an LTIC system specified > 


by - 
d*y | ay dx 

o_o 3— , ong ma 5x 

rTE -+ rT +2y(t) PT. + 5x(t) 


if the input is a sinusoid 20 sin (3f + 35°). 
Answers 


10.23 sin (3t —61.91°) 


4.8-1 Steady-State Response to Causal Sinusoidal Inputs 


So far we have discussed the LTIC system response to everlasting sinusoidal inputs (starting at f = — co). In practice, we are more interested in 
causal sinusoidal inputs (sinusoids starting at tf = 0). Consider the input ety (t), which starts at tf = 0 rather than at t = —oo. In this case X(s) = 1/(s 
+ ju). Moreover, according to Eq. (4.43), H(s) = P(s)/Q(s), where Q(s) is the characteristic polynomial given by Q(s) = (s — A4)(S — Az) (Ss 


Ap)-[4] Hence, 


P(s) 
(s —A1)(S —Az)-++ (S —An)(s — ja) 


In the partial fraction expansion of the right-hand side, let the coefficients corresponding to the N terms (s -?7), (S-?2), ..., (S- ?;y) be ky, ko,..., Ky. 
The coefficient corresponding to the last term (s — jud) is P(s)/Q(S)|s=jw = H(jw). Hence, 


.. k H(jo) 
Yy(sy=>- pet bee 


s-A; S—jo 


Y(s) = X(s)H(s) = 


and 


n 
yi) = So kie™ u(t) + H(jw)e! u(t) (4.79) 
en se 


i=] 
< Sicady-state component Ve (1) 


transient Component ¥:, (1) 
For an asymptotically stable system, the characteristic mode terms eft decay with time, and, therefore, constitute the so-called transient component 
of the response. The last term H(jw)e/ persists forever, and is the steady-state component of the response given by 
Vy5(1) = H( joe u(t) 


This result also explains why an everlasting exponential input e/t results in the total response H(ju)e/* for BIBO systems. Because the input 
started at t = — oo, at any finite time the decaying transient component has long vanished, leaving only the steady-state component. Hence, the total 


response appears to be H(jw)e/F. 


From the argument that led to Eq. (4.75a), it follows that for a causal sinusoidal input cos wot, the steady-state response y,,(f) is given by 


¥.e(0) = |H(jo)|cos [or + 4H (jo)ju(t) (4.80) 


In summary, |H(jw)|cos[wt + 2 H(jw)] is the total response to everlasting sinusoid cos uot. In contrast, it is the steady-state response to the same 
input applied at t = 0. 


[tl This may also be argued as follows. For BIBO-unstable systems, the zero-input response contains nondecaying natural mode terms of the form 
cos Wot or et cos Wot (a > 0). Hence, the response of such a system to a sinusoid cos wit will contain not just the sinusoid of frequency w, but 


also nondecaying natural modes, rendering the concept of frequency response meaningless. Alternately, we can argue that when s = jw, a BIBO- 
unstable system violates the dominance condition Re A; < Re jw for all i, where )j;, represents ith characteristic root of the system (see Section 4.3- 


1). 


[#4 strictly speaking, |H(w)| is magnitude response. There is a fine distinction between amplitude and magnitude. Amplitude A can be positive and 
negative. In contrast, the magnitude |A| is always nonnegative. We refrain from relying on this useful distinction between amplitude and magnitude in 
the interest of avoiding proliferation of essentially similar entities. This is also why we shall use the "amplitude" (instead of "magnitude") spectrum for 


|H(w)}. 


[t]A puzzling aspect of this result is that in deriving the transfer function of the integrator in Eq. (4.48), we have assumed that the input starts at f = 0. 


In contrast, in deriving its frequency response, we assume that the everlasting exponential input eft starts at f= —0o. There appears to be a 
fundamental contradiction between the everlasting input, which starts at t = —oo, and the integrator, which opens its gates only at t = 0. What use is 
everlasting input, since the integrator starts integrating at t = 0? The answer is that the integrator gates are always open, and integration begins 
whenever the input starts. We restricted the input to start at tf = 0 in deriving Eq. (4.48) because we were finding the transfer function using the 
unilateral transform, where the inputs begin at t = 0. So the integrator starting to integrate at t = 0 is restricted because of the limitations of the 
unilateral transform method, not because of the limitations of the integrator itself. If we were to find the integrator transfer function using Eq. (2.49), 
where there is no such restriction on the input, we would still find the transfer function of an integrator as 1/s. Similarly, even if we were to use the 
bilateral Laplace transform, where ft starts at — co, we would find the transfer function of an integrator to be 1/s. The transfer function of a system is 
the property of the system and does not depend on the method used to find it. 


[t]For simplicity, we have assumed nonrepeating characteristic roots. The procedure is readily modified for repeated roots, and the same conclusion 
results. 


4.9 BODE PLOTS 


Sketching frequency response plots (|H(jw)| and ZH(jw) versus w) is considerably facilitated by the use of logarithmic scales. The amplitude and 
phase response plots as a function of w on a logarithmic scale are known as Bode plots. By using the asymptotic behavior of the amplitude and the 
phase responses, we can sketch these plots with remarkable ease, even for higher-order transfer functions. 


Let us consider a system with the transfer function 


K(s + a,)(S + a) 
Hisy = ———-——_——_. (4.81a 
s(s + b,)(s* + bos + bs) , 


where the second-order factor (s? + bos + b3) is assumed to have complex conjugate roots.'T] We shall rearrange Eq. (4.81a) in the form 


ae) Ea 
_ Kaa; ay ay 


H(s)= > Oo 4.81b 
bi (2 41)(£ 4241) _ 
pete pe ip? 
b, b bs 
and 
can) (+8) 
H(je) = — 2 SE. (4.81c) 
by bs j (1 + a f ‘. — aa 
@ _ + 
: by b; b; 
This equation shows that H(jw) is a complex function of w. The amplitude response |H(jw)) and the phase response 2H(jw) are given by 
Kaa | + i at _ 
|H(jo)| = ———= 4 ——— (4.82a) 
by by l - it , jo i ' bow (ja) 
@ —_ ss 
se RE | ba Oo a 
and 
‘ ja jo : 
L£H( =Z[1+—)]+l[1+—]—Zje 
J@) ( a ) ( a ) jo 
jo jb (joy 
Z{1- rae + (4.82b 
( a ) | te! 8 | 


From Eq. (4.82b) we see that the phase function consists of the addition of only three kinds of term: (i) the phase of jw), which is 90° for all values of 
wv, (ii) the phase for the first-order term of the form 1 + jw/a, and (iii) the phase of the second-order term 


jbow zi 
1 Po ct ate 
| ie * ee 


We can plot these three basic phase functions for w in the range 0 to oo and then, using these plots, we can construct the phase function of any 
transfer function by properly adding these basic responses. Note that if a particular term is in the numerator, its phase is added, but if the term is in 
the denominator, its phase is subtracted. This makes it easy to plot the phase function 2H(juw) as a function of w. Computation of |H(ju)|, unlike that 
of the phase function, however, involves the multiplication and division of various terms. This is a formidable task, especially when, we have to plot 
this function for the entire range of w (0 to o). 


We know that a log operation converts multiplication and division to addition and subtraction. So, instead of plotting |H(jw)|, why not plot log |H(jw)| 
to simplify our task? We can take advantage of the fact that logarithmic units are desirable in several applications, where the variables considered 
have a very large range of variation. This is particularly true in frequency response plots, where we may have to plot frequency response over a 


range from a very low frequency, near 0, to a very high frequency, in the range of 1019 or higher. A plot on a linear scale of frequencies for such a 


large range will bury much of the useful information at lower frequencies. Also, the amplitude response may have a very large dynamic range from a 


low of 10-6 toa high of 10°. A linear plot would be unsuitable for such a situation. Therefore, logarithmic plots not only simplify our task of plotting, 
but, fortunately, they are also desirable in this situation. 


There is another important reason for using logarithmic scale. The Weber-Fechner law (first observed by Weber in 1834) states that human senses 
(sight, touch, hearing, etc.) generally respond in logarithmic way. For instance, when we hear sound at two different power levels, we judge one 
sound twice as loud when the ratio of the two sound powers is 10. Human senses respond to equal ratios of power, not equal increments in 


power. !11] This is clearly a logarithmic response. |T] 


The logarithmic unit is the decibel and is equal to 20 times the logarithm of the quantity (log to the base 10). Therefore, 20 log49 |H(jw)| is simply the 


log amplitude in decibels (dB). [41 Thus, instead of plotting |H(jw)|, we shall plot 20 log49 |H(jw)| as a function of w. These plots (log amplitude and 
phase) are called Bode plots. For the transfer function in Eq. (4.82a), the log amplitude is 


Kaa; P rm 
20 log |H(ja)| = 20 log — +20 log|1 + ~ +20 log] 1 + = — Wlog | jool 
193 ay 2 
by Gay? 
he 2010g|1 + | —20log|1 + ae + a (4.83) 
' , 5 


The term 20 log(Ka,a2/b;63) is a constant. We observe that the log amplitude is a sum of four basic terms corresponding to a constant, a pole or 


zero at the origin (20 log |/w]), a first-order pole or zero (20 log |1 + jw/al), and complex-conjugate poles or zeros (20 log |1 + jwb2/b3 + (jw)*/b3)). 


We can sketch these four basic terms as functions of w and use them to construct the log-amplitude plot of any desired transfer function. Let us 
discuss each of the terms. 


4.9-1 Constant ka, az/b, b3 


The log amplitude of the constant ka1a2/b;b2 term is also a constant, 20 log(Ka;az/b4b3). The phase contribution from this term is zero for positive 
value and Tt for negative value of the constant. 


4.9-2 Pole (or Zero) at the Origin 
LOG MAGNITUDE 


A pole at the origin gives rise to the term —20 log |jw|, which can be expressed as 
—20 log | j@| = —20log a 
This function can be plotted as a function of w. However, we can effect further simplification by using the logarithmic scale for the variable wo itself. 


Let us define a new variable u such that 
u=logw 


Hence 
—20 log m = —20u 


The log-amplitude function —20u is plotted as a function of u in Fig. 4.38a. This is a straight line with a slope of —20. It crosses the u axis at u = 0. 
The w-scale (u = log w) also appears in Fig. 4.38a. Semilog graphs can be conveniently used for plotting, and we can directly plot w on semilog 
paper. A ratio of 10 is a decade, and a ratio of 2 is known as an octave. Furthermore, a decade along the w-scale is equivalent to 1 unit along the 


u-scale. We can also show that a ratio of 2 (an octave) along the w-scale equals to 0.3010 (which is logj9 2) along the u-scale.!T] 
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Figure 4.38: (a) Amplitude and (b) phase responses of a pole or a zero at the origin. 


Note that equal increments in u are equivalent to equal ratios on the w-scale. Thus, one unit along the u-scale is the same as one decade along the 
w-scale. This means that the amplitude plot has a slope of —20 dB/decade or —20(0.3010) = —6.02 dB/octave (commonly stated as —6 dB/octave). 
Moreover, the amplitude plot crosses the w axis at w = 1, since u = logyg w = 0 when w = 1. 


For the case of a zero at the origin, the log-amplitude term is 20 log w. This is a straight line passing through w = 1 and having a slope of 20 


dB/decade (or 6 dB/octave). This plot is a mirror image about the w axis of the plot for a pole at the origin and is shown dashed in Fig. 4.38a. 
PHASE 


The phase function corresponding to the pole at the origin is — zjw [see Eq. (4.82b)]. Thus 


LH(j@) = —Ljw = —90 

The phase is constant (— 90°) for all values of w, as depicted in Fig. 4.38b. For a zero at the origin, the phase is zjw = 90°. This is a mirror image 
of the phase plot for a pole at the origin and is shown dotted in Fig. 4.38b. 

4.9-3 First-Order Pole (or Zero) 


THE LOG MAGNITUDE 
The log amplitude of a first-order pole at -a is —20 log |1 + jw/a|. Let us investigate the asymptotic behavior of this function for extreme values of w 


(WwW < a and Ww >> a). 
a. Forw <a, 


~ —20log1 = 0 


—20 oe) = = 


Hence, the log-amplitude function — 0 asymptotically for w « a (Fig. 4.39a). 
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Figure 4.39: (a) Amplitude and (b) phase responses of a first-order pole or zero at s = —a. 


b. For the other extreme case, where W >> a, 


—20 log 


142°! ~ -20 woe(*) (4.84a) 
a a 


= —20logw + 20loga (4.84b) 
= —20u + 20loga 


This represents a straight line (when plotted as a function of u, the log of w) with a slope of —20 dB/decade (or —6 dB/octave). When w = a, the log 
amplitude is zero [Eq. (4.84b)]. 


Hence, this line crosses the w axis at w = a, as illustrated in Fig. 4.39a. Note that the asymptotes in (a) and (b) meet at w = a. 


The exact log amplitude for this pole is 


4 -20I09( + -) 


1422 
a 

w 

= —101 | + — 

og( + -) 


This exact log magnitude function also appears in Fig. 4.39a. Observe that the actual and the asymptotic plots are very close. A maximum error of 3 
dB occurs at w = a. This frequency is known as the corner frequency or break frequency. The error everywhere else is less than 3 dB. A plot of the 
error as a function of w is shown in Fig. 4.40a. This figure shows that the error at one octave above or below the corner frequency is 1 dB and the 
error at two octaves above or below the corner frequency is 0.3 dB. The actual plot can be obtained by adding the error to the asymptotic plot. 
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Figure 4.40: Errors in asymptotic approximation of a first-order pole at s = —a. 


The amplitude response for a zero at —a (shown dotted in Fig. 4.39a) is identical to that of the pole at —a with a sign change and therefore is the 
mirror image (about the O dB line) of the amplitude plot for a pole at —a. 


PHASE 


The phase for the first-order pole at —a is 


LH(j@) = -2(1 + i) =—tan7! (=) 
a a 


Let us investigate the asymptotic behavior of this function. For w < a, 


@ 
—tan™! (<) <0 
a 


and, for >> a, 


@ . 

—tan7! (=) m —90° 
a 

The actual plot along with the asymptotes is depicted in Fig. 4.39b. In this case, we use a three-line segment asymptotic plot for greater accuracy. 

The asymptotes are a phase angle of 0° for w < a/10, a phase angle of —90° for w = 10a, and a straight line with a slope —45°/decade connecting 

these two asymptotes (from w = a/10 to 10a) crossing the w axis at w = a/10. It can be seen from Fig. 4.39b that the asymptotes are very close to 


the curve and the maximum error is 5.7°. Figure 4.40b plots the error as a function of w; the actual plot can be obtained by adding the error to the 
asymptotic plot. 


The phase for a zero at —a (shown dotted in Fig. 4.39b) is identical to that of the pole at —a with a sign change, and therefore is the mirror image 
(about the 0° line) of the phase plot for a pole at —a. 


4.9-4 Second-Order Pole (or Zero) 
Let us consider the second-order pole in Eq. (4.81a). The denominator term is s? + b2s + b3. We shall introduce the often-used standard form s? + 
2TWns + G5 instead of s* + bos + b3. With this form, the log amplitude function for the second-order term in Eq. (4.83) becomes 


~20 log |1 + 2j¢— + (=) | (4.85a) 
Dy, 


Wp 


and the phase function is 


: 2 
=f 142 — 4 (=) (4.85b) 


n “ 


THE LOG MAGNITUDE 
The log amplitude is given by 


1 +23¢(=) rs (=) | (4.86) 


For W < Wry, the log amplitude becomes 


log amplitude ~ —20 log | = 0 


log amplitude = —20 log 


For W >> Wp, the log amplitude is 


(-=) | = —40 log (=) (4.87a) 
Wy ®, 


= —40 log @ — 40 log @, (4.87b) 
= —40u — 40 log o, (4.87) 


The two asymptotes are zero for w < Ww, and — 40u — 40 logwy for w > Wy. The second asymptote is a straight line with a slope of —40 
dB/decade (or —12 dB/octave) when plotted against the log w scale. It begins at w = wy [see Eq. (4.87b)]. The asymptotes are depicted in Fig. 


4.41a. The exact log amplitude is given by [see Eq. (4.86)] 


42 2)? 
log amplitude = -2010e{ [1 ~ (=) +473(*) } (4.88) 
o, Wy 
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Figure 4.41: Amplitude and phase response of a second-order pole. 


The log amplitude in this case involves a parameter T, resulting in a different plot for each value of C. For complex-conjugate poles, lt] C < 1. Hence, 
we must sketch a family of curves for a number of values of T in the range 0 to 1. This is illustrated in Fig. 4.41a. The error between the actual plot 
and the asymptotes is shown in Fig. 4.42. The actual plot can be obtained by adding the error to the asymptotic plot. 
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Figure 4.42: Errors in the asymptotic approximation of a second-order pole. 


For second-order zeros (complex-conjugate zeros), the plots are mirror images (about the OdB line) of the plots depicted in Fig. 4.41a. Note the 
resonance phenomenon of the complex-conjugate poles. This phenomenon is barely noticeable for € > 0.707 but becomes pronounced as TC — 0. 


PHASE 


The phase function for second-order poles, as apparent in Eq. (4.85b), is 


@ 
2x (=) 
£H(jo) = —tan’ ce a (4.89) 


For W < Wp, 
LH(jw) ~0 

For W >> Wh, 
LH(jw) ~ —180° 


Hence, the phase — —180° as w — o. As in the case of amplitude, we also have a family of phase plots for various values of TC, as illustrated in 
Fig. 4.41b. A convenient asymptote for the phase of complex-conjugate poles is a step function that is 0° for w < Ww, and —180° for w > Wry. An 
error plot for such an asymptote is shown in Fig. 4.42 for various values of €. The exact phase is the asymptotic value plus the error. 


For complex-conjugate zeros, the amplitude and phase plots are mirror images of those for complex conjugate-poles. 
We shall demonstrate the application of these techniques with two examples. 


EXAMPLE 4.25 _ 7 : : 
Sketch Bode plots for the transfer function 


20s(s + 100 
BG ee 
(s +2)(s + 10) 
First, we write the transfer function in normalized form 


s s 
* (1+ 55) (1+) 
H(s)= vain ee = 100 100 


PO Ne) OB) 


Here, the constant term is 100; that is, 40 dB (20 log 100 = 40). This term can be added to the plot by simply relabeling the horizontal axis (from 
which the asymptotes begin) as the 40 dB line (see Fig. 4.43a). Such a step implies shifting the horizontal axis upward by 40 dB. This is precisely 
what is desired. 
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Figure 4.43: (a) Amplitude and (b) phase responses of the second-order system. 


In addition, we have two first-order poles at -2 and —10, one zero at the origin, and one zero at — 100. 


Step 1. For each of these terms, we draw an asymptotic plot as follows (shown in Fig. 4.43a by dotted lines): 


For the zero at the origin, draw a straight line with a slope of 20 dB/decade passing through w = 1. 


. For the pole at —2, draw a straight line with a slope of —20 dB/decade (for w > 2) beginning at the corner frequency w = 2 
iii. For the pole at —10, draw a straight line with a slope of —20 dB/decade beginning at the corner frequency w = 10. 


. For the zero at — 100, draw a straight line with a slope of 20 dB/decade beginning at the corner frequency w = 100. 


Step 2. Add all the asymptotes, as depicted in Fig. 4.43a by solid line segments. 


Step 3. Apply the following corrections (see Fig. 4.40a): 


The correction at w = 1 because of the corner frequency at w = 2 is —1 dB. The correction at w = 1 because of the corner frequencies 
at w — 10 and w = 100 are quite small (see Fig. 4.40a) and may be ignored. Hence, the net correction at w = 1 is —1 dB. 


ii. The correction at w = 2 because of the corner frequency at w = 2 is — 3 dB, and the correction because of the corner frequency at w 


= 10 is —0.17 dB. The correction because of the corner frequency w = 100 can be safely ignored. Hence the net correction at w = 2 is 
—3.17 dB. 


The correction at w = 10 because of the corner frequency at w = 10 is —3 dB, and the correction because of the corner frequency at 
w = 2 is —0.17 dB. The correction. because of w = 100 can be ignored. Hence the net correction at w = 10 is — 3.17dB. 


. The correction at w = 100 because of the corner frequency at w = 100 is 3 dB, and the corrections because of the other corner 


frequencies may be ignored. 


In addition to the corrections at corner frequencies, we may consider corrections at intermediate points for more accurate plots. For 
instance, the corrections at w = 4 because of corner frequencies at w = 2 and 10 are —1 and about —0.65, totaling — 1.65 dB. In the 
same way the correction at w = 5 because of corner frequencies at w = 2 and 10 are —0.65 and —1, totaling —1.65 dB. 


With these corrections, the resulting amplitude plot is illustrated in Fig. 4.43a. 


PHASE PLOTS 


We draw the asymptotes corresponding to each of the four factors: 


. The zero at the origin causes a 90° phase shift. 


. The pole at s = — 2 has an asymptote with a zero value for — «© < w <0.2 anda slope of —45°/decade beginning at w = 0.2 and 


going up to w = 20. The asymptotic value for w > 20 is —90°. 


The pole at s = —10 has an asymptote with a zero value for — 0 < w <1 anda slope of — 45°/decade beginning at w = 10 and going 
up to w = 100. The asymptotic value for w > 100 is —90°. 


. The zero at s = —100 has an asymptote with a zero value for — 0 < w < 10 and a slope of —45°/decade beginning at w = 10 and 


going up to w = 1000. The asymptotic value for w > 1000 is 90°. All the asymptotes are added, as shown in Fig. 4.43b. The 
appropriate corrections are applied from Fig. 4.40b, and the exact phase plot is depicted in Fig. 4.43b. 


EXAMPLE 4.26 
Sketch the amplitude and phase response (Bode plots) for the transfer function 
Ss 
10(s + 100) +75 
A(s)= RTA 19 ——_100__ 
s?+2s +100 i447 
50-100 


Here, the constant term is 10: that is, 20 dB(20 log 10 = 20). To add this term, we simply label the horizontal axis (from which the asymptotes begin) 
as the 20 dB line, as before (see Fig. 4.44a). 
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Figure 4.44: (a) Amplitude and (b) phase responses of the second-order system. 


In addition, we have a real zero at s = — 100 and a pair of complex conjugate poles. When we express the second-order factor in standard form, 


s? +25 +100 =5? + 2¢a,5 +02 


we have 


w, = 10 and f=0.1 


Step 1. Draw an asymptote of —40 dB/decade (— 12 dB/octave) starting at w = 10 for the complex conjugate poles, and draw another asymptote of 
20 dB/decade, starting at w = 100 for the (real) zero. 


Step 2. Add both asymptotes. 


Step 3. Apply the correction at w = 100, where the correction because of the corner frequency w = 100 is 3 dB. The correction because of the 
corner frequency w = 10, as seen from Fig. 4.42a for € =0.1, can be safely ignored. Next, the correction at w = 10, because of the corner frequency 
Ww = 10 is 13.90 dB (see Fig. 4.42a for € = 0.1). The correction because of the real zero at — 100 can be safely ignored at w = 10. We may find 
corrections at a few more points. The resulting plot is illustrated in Fig. 4.44a. 


PHASE PLOT 


The asymptote for the complex conjugate poles is a step function with a jump of —90° at w = 10. The asymptote for the zero at s = —100 is zero for 
w > 10 and is a straight line with a slope of 45°/decade, starting at w = 10 and going to w = 1000. For w = 1000, the asymptote is 90°. The two 
asymptotes add to give the sawtooth shown in Fig. 4.44b. We now apply the corrections from Figs. 4.42b and 4.40b to obtain the exact plot. 


Comment. These two examples demonstrate that actual frequency response plots are very close to asymptotic plots, which are so easy to construct. 
Thus, by mere inspection of H(s) and its poles and zeros, one can rapidly construct a mental image of the frequency response of a system. This is 
the principal virtue of Bode plots. 


COMPUTER EXAMPLE C4.6 
Use MATLAB function bode to solve Examples 4.25 and 4.26. 


>> bode (tf(conv([20 0],[1 100]), conv([{l 2],[1 10])), 'k-',... 
>> tf£({10 1000], [1 2 100]), 'k: '); 
>> legend( 'Ex. 4.25 ', 'Ex. 4.26 ',0) 
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Figure C4.6 


POLES AND ZEROS IN THE RIGHT-HAND PLANE 

In our discussion so far, we have assumed the poles and zeros of the transfer function to be in the left-hand plane. What if some of the poles and/or 
zeros of H(s) lie in the RHP? If there is a pole in the RHP, the system is unstable. Such systems are useless for any signal processing application. 
For this reason, we shall consider only the case of the RHP zero. The term corresponding to RHP zero at s = a is (s/a) — 1, and the corresponding 
frequency response is (jw/a) — 1. The amplitude response is 


: 9 1/2 
_ = 1|= (Ss + 1) 
ae 


—-1 
a 

This shows that the amplitude response of an RHP zero at s = a is identical to that of an LHP zero or s = —a. Therefore, the log amplitude plots 

remain unchanged whether the zeros are in the LHP or the RHP. However, the phase corresponding to the RHP zero at s = a is 


¢{at) m2= (1-#) were (2) me ue(*) 
a a a a 


whereas the phase corresponding to the LHP zero at s = —a is tan™'(w/a). 


The complex-conjugate zeros in the RHP give rise to a term s? — 2GWns + Wp, which is identical to the term s@ + 2Gwps + w?, with a sign 
change in C. Hence, from Eqs. (4.88) and (4.89) it follows that the amplitudes are identical, but the phases are of opposite signs for the two terms. 


Systems whose poles and zeros are restricted to the LHP are classified as minimum phase systems 


4.9-5 The Transfer Function from the Frequency Response 


In the preceding section we were given the transfer function of a system. From a knowledge of the transfer function, we developed techniques for 
determining the system response to sinusoidal inputs. We can also reverse the procedure to determine the transfer function of a minimum phase 
system from the system 's response to sinusoids. This application has significant practical utility. If we are given a system in a black box with only the 
input and output terminals available, the transfer function has to be determined by experimental measurements at the input and output terminals. The 
frequency response to sinusoidal inputs is one of the possibilities that is very attractive because the measurements involved are so simple. One only 
needs to apply a sinusoidal signal at the input and observe the output. We find the amplitude gain |H(juw.)| and the output phase shift 2H (ju) (with 
respect to the input sinusoid) for various values of w over the entire range from 0 to oo. This information yields the frequency response plots (Bode 
plots) when plotted against log w. From these plots we determine the appropriate asymptotes by taking advantage of the fact that the slopes of all 
asymptotes must be multiples of +20 dB/decade if the transfer function is a rational function (function that is a ratio of two polynomials in s). From 
the asymptotes, the corner frequencies are obtained. Corner frequencies determine the poles and zeros of the transfer function. Because of the 
ambiguity about the location of zeros since LHP and RHP zeros (zeros at s = +a) have identical magnitudes, this procedure works only for minimum 
phase systems. 


[tlCoefficients a1, a7 and b1, bz, b3 used in this section are not to be confused with those used in the representation of Nth-order LTIC system 
equations given earlier [Eqs. (2.1) or (4.41)]. 


[11lTruxal, J. G. The Age of Electronic Messages. McGraw-Hill, New York, 1990. 


[tlObserve that that the frequencies of musical notes are spaced logarithmically (not linearly). The octave is a ratio of 2. The frequencies of the same 
note in the successive octaves have a ratio of 2. On the Western musical scale, there are 12 distinct notes in each octave. The frequency of each 
note is about 6% higher than the frequency of the preceding note. Thus, the successive notes are separated not by some constant frequency, but by 
constant ratio of 1.06. 


[#Originally, the unit be/ (after the inventor of telephone, Alexander Graham Bell) was introduced to represent power ratio as logj9, P2/P 1 bels. A 
tenth of this unit is a decibel, as in 10 logy9 P2/P 2 decibels. Since, the power ratio of two signals is proportional to the amplitude ratio squared, or 


|H(juo)|2, we have 10 logig P2/P4 = 10 logyg |H(jw)|? = 20 logy9|H(jw)| dB. 


[Tl This point can be shown as follows. Let w4 and w2 along the w-scale correspond to u; and uz along the u-scale so that log w 1 = uy, and log 
W2 = Ug. Then 


lg — hy = logyy 2 — logy) @ = log))(@2/a) 


Thus, if 

(w/e) = 10 (which is a decade) 
uy —, = log,, 10 = 1 

then 

(w2/w,) = 2 (which is an octave) 

and if 

uy — uy = logy, 2 = 0.3010 

then 


uy — uy = logy, 2 = 0.3010 


[tlFor TC = 1, the two poles in the second-order factor are no longer complex but real, and each of these two real poles can be dealt with as a 


separate first-order factor. 


4.10 FILTER DESIGN BY PLACEMENT OF POLES AND ZEROS OF H(s) 


In this section we explore the strong dependence of frequency response on the location of poles and zeros of H(s). This dependence points to a 
simple intuitive procedure to filter design. 


4.10-1 Dependence of Frequency Response on Poles and Zeros of H(s) 


Frequency response of a system is basically the information about the filtering capability of the system. A system transfer function can be expressed 
as 


P(s) (s — z)(8 —Z2)+++ (8 — zy) 
H(s) = — = by ———— (4.90a 
Os) "@—MMi—aa)-+— An) ) 


where 1, 2, Nn are ?4, ?9,.... Ay are the poles of H(s). Now the value of the transfer function H(s) at some frequency s = p is 


(p — 21)(p — Z2) +++ (p — Zn) 


H(S)|rnp = by 7 (4.90b) 
Po "(D = YP = da) (P= dy) 
This equation consists of factors of the form p — ; and p — ij. The factor p — ; is a complex number represented by a vector drawn from point to the 
point p in the complex plane, as illustrated in Fig. 4.45a. The length of this line segment is | p — j| the magnitude of p — ;. The angle of this directed 
line segment (with the horizontal axis) is 2(p — ;). To compute H(s) at s = p, we draw line segments from all poles and zeros of H(s) to the point p, 
as shown in Fig. 4.45b. The vector connecting a zero ; to the point p is p — ;. Let the length of this vector be rj, and let its angle with the horizontal 
axis be @;. Then p — ; = reli. Similarly, the vector connecting a pole A; to the point p is p — A; = d,e!%i, where d; and 9;, are the length and the 


angle (with the horizontal axis), respectively, of the vector p — A; Now from Eq. (4.90b) it follows that 
H( ) b (r,e/%)(r,ef#) «- + (ry elo) 
S\s=p = 00557-73909 770 
me" (dyei%)(dpei®) - -- (dye) 
“Ty eildr drt tox) Or4Oo+-+6y)] 
dy 
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Figure 4.45: Vector representations of (a) complex numbers and (b) factors of H(s). 


Therefore 
WiT2°** Ty 
|H(s)\,-, = bp ————— 
RT dda dy 
product of the distances of zeros to p 
he (4.9la) 
product of the distances of poles to p 
and 
LH (S)hap = (O; +2 +++ + On) — (0, +62 +--+ + On) 
= sum of zero angles to p — sum of pole angles to p (4.91b) 


Here, we have assumed positive bo. If bo is negative, there is an additional phase tr. Using this procedure, we can determine H(s) for any value of 
s. To compute the frequency response H(jw), we use s = jw (a point on the imaginary axis), connect all poles and zeros to the point jw, and 
determine |H(jw)| and ZH(jw) from Eqs. (4.91). We repeat this procedure for all values of w from 0 to o to obtain the frequency response. 


GAIN ENHANCEMENT BY A POLE 

To understand the effect of poles and zeros on the frequency response, consider a hypothetical case of a single pole —« + jwg, as depicted in Fig. 
4.46a. To find the amplitude response |H(jw)| for a certain value of w, we connect the pole to the point jw (Fig. 4.46a). If the length of this line is d, 
then |H(jw)| is proportional to 1/d, 


K 
|H(jw)| = 5 (4.92) 


where the exact value of constant K is not important at this point. As w increases from zero, d decreases progressively until w reaches the value 
Wo. As w increases beyond Wo, d increases progressively. Therefore, according to Eq. (4.92), the amplitude response |H(jw)| increases from w — 0 
until wW = Wo, and it decreases continuously as w increases beyond Wo, as illustrated in Fig. 4.46b. Therefore, a pole at —a« + jwo results in a 
frequency-selective behavior that enhances the gain at the frequency Wo (resonance). Moreover, as the pole moves closer to the imaginary axis (as 
a is reduced), this enhancement (resonance) becomes more pronounced. This is because «, the distance between the pole and jwo (d 
corresponding to jwo), becomes smaller, which increases the gain K/d. In the extreme case, when «& = 0 (pole on the imaginary axis), the gain at %> 
goes to infinity. Repeated poles further enhance the frequency-selective effect. To summarize, we can enhance a gain at a frequency Wo by placing 
a pole opposite the point jwo. The closer the pole is to jw, the higher is the gain at wo, and the gain variation is more rapid (more frequency 
selective) in the vicinity of frequency Wo- Note that a pole must be placed in the LHP for stability. 
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Figure 4.46: The role of poles and zeros in determining the frequency response of an LTIC system. 


Here we have considered the effect of a single complex pole on the system gain. For a real system, a complex pole —« + jwa must accompany its 
conjugate —« — jwWg. We can readily show that the presence of the conjugate pole does not appreciably change the frequency-selective behavior in 
the vicinity of Wo. This is because the gain in this case is K/dd’, where d’ is the distance of a point ju from the conjugate pole —« — jwo. Because 
the conjugate pole is far from jw, there is no dramatic change in the length d’ as w varies in the vicinity of wo. There is a gradual increase in the 
value of d’ as w increases, which leaves the frequency-selective behavior as it was originally, with only minor changes. 


GAIN SUPPRESSION BY A ZERO 

Using the same argument, we observe that zeros at — « +/Wog (Fig. 4.46d) will have exactly the opposite effect of suppressing the gain in the vicinity 
of Wa, as shown in Fig. 4.46e). A zero on the imaginary axis at jw will totally suppress the gain (zero gain) at frequency Wo. Repeated zeros will 
further enhance the effect. Also, a closely placed pair of a pole and a zero (dipole) tend to cancel out each other 's influence on the frequency 
response. Clearly, a proper placement of poles and zeros can yield a variety of frequency-selective behavior. We can use these observations to 
design lowpass, highpass, bandpass, and bandstop (or notch) filters. 


Phase response can also be computed graphically. In Fig. 4.46a, angles formed by the complex conjugate poles —« + jWo), at w — 0 (the origin) 
are equal and opposite. As w increases from 0 up, the angle 6, (due to the pole —« + jw), which has a negative value at w = 0,is reduced in 
magnitude; the angle 82 because of the pole —« — jwg, which has a positive value at w = 0, increases in magnitude. As a result, 8, + 65, the sum 
of the two angles, increases continuously, approaching a value TT as W — oo. The resulting phase response 2H(jw)) = —(84 + 82) is illustrated in 
Fig. 4.46c. Similar arguments apply to zeros at —« + jw. The resulting phase response 2H(jw) = (p41 + 2) is depicted in Fig. 4.46f. 


We now focus on simple filters, using the intuitive insights gained in this discussion. The discussion is essentially qualitative. 


4.10-2 Lowpass Filters 


A typical lowpass filter has a maximum gain at w = 0. Because a pole enhances the gain at frequencies in its vicinity, we need to place a pole (or 
poles) on the real axis opposite the origin (jw = 0), as shown in Fig. 4.47a. The transfer function of this system is 


H(s)= 


De 


S+o, 
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Figure 4.47: Pole-zero configuration and the amplitude response of a lowpass (Butterworth) filter. 


We have chosen the numerator of H(s) to be Ww, to normalize the dc gain H(0) to unity. If d is the distance from the pole —w), to a point jw (Fig. 
4.47a), then 


|H( . | De 
))| = — 
ja a 


with H(0) = 1. As w to increases, d increases and |H (jw)| decreases monotonically with w), as illustrated in Fig. 4.47d with label N = 1. This is 
clearly a lowpass filter with gain enhanced in the vicinity of w = 0. 


WALL OF POLES 

An ideal lowpass filter characteristic (shaded in Fig. 4.47d) has a constant gain of unity up to frequency We,. Then the gain drops suddenly to 0 for w 
> w. To achieve the ideal lowpass characteristic, we need enhanced gain over the entire frequency band from 0 to W,. We know that to enhance a 
gain at any frequency w, we need to place a pole opposite w. To achieve an enhanced gain for all frequencies over the band (0 to w,), we need to 


place a pole opposite every frequency in this band. In other words, we need a continuous wall of poles facing the imaginary axis opposite the 
frequency band 0 to we, (and from 0 to — w, for conjugate poles), as depicted in Fig. 4.47b. At this point, the optimum shape of this wall is not 
obvious because our arguments are qualitative and intuitive. Yet, it is certain that to have enhanced gain (constant gain) at every frequency over this 
range, we need an infinite number of poles on this wall. We can show that for a maximally flat] response over the frequency range (0 to w,), the 
wall is a semicircle with an infinite number of poles uniformly distributed along the wall.[12]. In practice, we compromise by using a finite number (N) 
of poles with less-than-ideal characteristics. Figure 4.47c shows the pole configuration for a fifth-order (N = 5) filter. The amplitude response for 
various values of N are illustrated in Fig. 4.47d. As N — oo, the filter response approaches the ideal. This family of filters is known as the Butterworth 
filters. There are also other families. In Chebyshev filters, the wall shape is a semiellipse rather than a semicircle. The characteristics of a Chebyshev 
filter are inferior to those of Butterworth over the passband (0, w,), where the characteristics show a rippling effect instead of the maximally flat 
response of Butterworth. But in the stopband (w > w,), Chebyshev behavior is superior in the sense that Chebyshev filter gain drops faster than that 
of the Butterworth. 


4.10-3 Bandpass Filters 


The shaded characteristic in Fig. 4.48b shows the ideal bandpass filter gain. In the bandpass filter, the gain is enhanced over the entire passband. 
Our earlier discussion indicates that this can be realized by a wall of poles opposite the imaginary axis in front of the passband centered at wo. 


(There is also a wall of conjugate poles opposite —Ww ) Ideally, an infinite number of poles is required. In practice, we compromise by using a finite 
number of poles and accepting less-than-ideal characteristics (Fig. 4.48). 
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Figure 4.48: (a) Pole-zero configuration and (b) the amplitude response of a bandpass filter. 


4.10-4 Notch (Bandstop) Filters 


An ideal notch filter amplitude response (shaded in Fig. 4.49b) is a complement of the amplitude response of an ideal bandpass filter. Its gain is zero 
over a small band centered at some frequency Wo and is unity over the remaining frequencies. Realization of such a characteristic requires an 
infinite number of poles and zeros. Let us consider a practical second-order notch filter to obtain zero gain at a frequency Ww = Wg. For this purpose 
we must have zeros at +/wg. The requirement of unity gain at w = oo requires the number of poles to be equal to the number of zeros (M = N). This 
ensures that for very large values of w, the product of the distances of poles from w will be equal to the product of the distances of zeros from w. 
Moreover, unity gain at w = 0 requires a pole and the corresponding zero to be equidistant from the origin. For example, if we use two (complex- 
conjugate) zeros, we must have two poles; the distance from the origin of the poles and of the zeros should be the same. This requirement can be 
met by placing the two conjugate poles on the semicircle of radius Wo, as depicted in Fig. 4.49a. The poles can be any where on the semicircle to 
satisfy the equidistance condition. Let the two conjugate poles be at angles +8 with respect to the negative real axis. Recall that a pole and a zero in 
the vicinity tend to cancel out each other's influences. Therefore, placing poles closer to zeros (selecting 8 closer to Tr/2) results in a rapid recovery 
of the gain from value 0 to 1 as we move away from Wo in either direction. Figure 4.49b shows the gain |H(jw)| for three different values of 0. 
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Figure 4.49: (a) Pole-zero configuration and (b) the amplitude response of a bandstop (notch) filter. 


EXAMPLE 4.27 
Design a second-order notch filter to suppress 60 Hz hum in a radio receiver. 


We use the poles and zeros in Fig. 4.49a with Wo = 120TT. The zeros are at s = +/wo. The two poles are at — Wg cos 8 + jwg sin 0. The filter 
transfer function is (with Wo = 120TT) 
{s — Jm@o)(s + J@) 


(S + a COS 8 + jar sin #)(S + a cos 8 — jaro sin 9) 
_ s+? _ s? + 142122.3 
~ $24 (2ancos O)s +a@2 5? + (753.98 cos O)s + 142122.3 
and 
~w? + 142122.3 
|H(ja)| = 


J(—w? + 142122.3)? + (753.98 cos 8)" 


The closer the poles are to the zeros (the closer 6 is to 11/2), the faster the gain recovery from 0 to 1 on either side of Wo = 12011. Figure 4.49b 


shows the amplitude response for three different values of 8. This example is a case of very simple design. To achieve zero gain over a band, we 
need an infinite number of poles as well as of zeros. 


COMPUTER EXAMPLE C4.7 
The transfer function of a second-order notch filter is 


H(s) = a 
5? + (2a cos(@))s + ap 


Using Wo = 27160, plot the magnitude response for the following cases: 


a. 0, = 60° 
b. 8, = 80° 
c. 6, = 87° 
>> omega_0 = 2*pi*60; theta = [60 80 87]*(pi/180); 
>> omega = (0:.5:1000) '; mag = zeros (3,length (omega) ); 
>> for m=l:length (theta) 
>> H = tf£([1 0 omega_0*%2],{1 2*omega_O*cos (theta(m)) omega_0%2]); 
>> [mag (m,:),phase] = bode (H,omega); 
>> end 
>> £ = omega/(2*pi); plot (f,mag (1,:) ,'k-',f,mag (2,:),'k--',f£,mag(3,:),'k-.'); 
>> xlabel ('f [Hz] '); ylabel ('|H(j2\pi f) 1"); 


>> legend (\theta = 60*%\circ','\theta = 80*\circ','\theta = 87*\circ',0) 
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Figure C4.7 


EXERCISE E415 — _ —_ — ee 
Use the qualitative method of sketching the frequency response to show that the system with the pole-zero configuration in Fig. 4.50a is a highpass 
filter and the configuration in Fig. 4.50b is a bandpass filter. 
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(a) {b) 
Figure 4.50: Pole-zero configuration of (a) a highpass filter and (b) a bandpass filter. 


4.10-5 Practical Filters and Their Specifications 


For ideal filters, everything is black and white; the gains are either zero or unity over certain bands. As we saw earlier, real life does not permit such 
a worldview. Things have to be gray or shades of gray. In practice, we can realize a variety of filter characteristics that can only approach ideal 
characteristics. 


An ideal filter has a passband (unity gain) and a stopband (zero gain) with a sudden transition from the passband to the stopband. There is no 
transition band. For practical (or realizable) filters, on the other hand, the transition from the passband to the stopband (or vice versa) is gradual and 
takes place over a finite band of frequencies. Moreover, for realizable filters, the gain cannot be zero over a finite band (Paley-Wiener condition). As 
a result, there can no true stopband for practical filters. We therefore define a stopband to be a band over which the gain is below some small 
number Ge, as illustrated in Fig. 4.51. Similarly, we define a passband to be a band over which the gain is between 1 and some number Gp (Gp < 
1), as shown in Fig. 4.51. We have selected the passband gain of unity for convenience. It could be any constant. Usually the gains are specified in 
terms of decibels. This is simply 20 times the log (to base 10) of the gain. Thus 


G(dB) = 20log,, G 
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Figure 4.51: Passband, stopband, and transition band in filters of various types. 


A gain of unity is 0 dB and a gain of ./2 is 3.01 dB, usually approximated by 3 dB. Sometimes the specification may be in terms of attenuation, 
which is the negative of the gain in dB. Thus a gain of \/2; that is, 0.707, is —3 dB, but is an attenuation of 3 dB. 


In a typical design procedure, Gp, (minimum passband gain) and Gs (maximum stopband gain) are specified. Figure 4.51 shows the passband, the 
stopband, and the transition band for typical lowpass, bandpass, highpass, and bandstop filters. Fortunately, the highpass, bandpass, and bandstop 
filters can be obtained from a basic lowpass filter by simple frequency transformations. For example, replacing s with we/s in the lowpass filter 
transfer function results in a highpass filter. Similarly, other frequency transformations yield the bandpass and bandstop filters. Hence, it is necessary 
to develop a design procedure only for a basic lowpass filter. Then, by using appropriate transformations, we can design filters of other types. The 
design procedures are beyond our scope here and will not be discussed. Interested reader is referred to Ref. 1. 


[t]Maximally flat amplitude response means the first 2N — 1 derivatives of |H(jw)| with respect to w are zero at w = 0. 


M2]van Valkenberg, M. Analog Filter Design. Oxford University Press, New York, 1982. 


4.11 THE BILATERAL LAPLACE TRANSFORM 


Situations involving noncausal signals and/or systems cannot be handled by the (unilateral) Laplace transform discussed so far. These cases can be 
analyzed by the bilateral (or two-sided) Laplace transform defined by 
oD 


X(s) = / x(the" dt 
OS 
and x(t) can be obtained from X(s) by the inverse transformation 
I C+ JOO 
x(t) = =— X(s)e" ds 
Lm J c—joo 
Observe that the unilateral Laplace transform discussed so far is a special case of the bilateral Laplace transform, where the signals are restricted to 
the causal type. Basically, the two transforms are the same. For this reason we use the same notation for the bilateral Laplace transform. 


Earlier we showed that the Laplace transforms of e~@ u(t) and of —eat u(—t) are identical. The only difference is in their regions of convergence 
(ROC). The ROC for the former is Re s > —a; that for the latter is Re s < —a; as illustrated in Fig. 4.1. Clearly, the inverse Laplace transform of X(s) 
is not unique unless the ROC is specified. If we restrict all our signals to the causal type, however, this ambiguity does not arise. The inverse 


transform of 1/(s + a) is e~@ u(t). Thus, in the unilateral Laplace transform, we can ignore the ROC in determining the inverse transform of X(s). 


We now show that any bilateral transform can be expressed in terms of two unilateral transforms. It is, therefore, possible to evaluate bilateral 
transforms from a table of unilateral transforms. 


Consider the function x(t) appearing in Fig. 4.52a. We separate x(t) into two components, x(t) and x(t), representing the positive time (causal) 


component and the negative time (anticausal) component of x(t), respectively (Fig. 4.52b and 4.52c): 
X(t) = x(t)u(t) 


X2(t) = x(t)u(—t) 


xf) 


x(p 


0 — 


{b) 


x(t) 


rf{-) 


0 rear 


(d) 
Figure 4.52: Expressing a signal as a sum of causal and anticausal components. 


The bilateral Laplace transform of x(t) is given by 


so 
X(s) = / x(njew" dt 


x 


A~ oo 
=| x,(t)e~" dt + x,(1)e~" dt 


= X2(s) + Xi(s) (4.93) 


where X4(s) is the Laplace transform of the causal component x,(t) and X2(s) is the Laplace transform of the anticausal component x(t). Consider 
X(S), given by 
0 


x,(s) = [ x,(the" dt 
Js =a 


oo 
[ x2(—1)e" di 
Or 
Therefore 


oO 
X3(-s) -{ x,(—ne" dt 
or 


If x(t) has any impulse or its derivative(s) at the origin, they are included in x, (t). Consequently, xo(t) = 0 at the origin; that is, x2(0) = 0. Hence, the 
lower limit on the integration in the preceding equation can be taken as 0° instead of 0*. Therefore 


oO 
X2(—S) - | x2(—t)e" dt 
/0 


Because x2(—f) is causal (Fig. 4.52d), X2(—s) can be found from the unilateral transform table. Changing the sign of s in X2(—s) yields X2(s). 
To summarize, the bilateral transform X(s) in Eq. (4.93) can be computed from the unilateral transforms in two steps: 
1. Split x(t) into its causal and anticausal components, x, (f) and x(t), respectively. 


2. The signals x4(t) and x2(—t) are both causal. Take the (unilateral) Laplace transform of x4(t) and add to it the (unilateral) Laplace 
transform of x2(—?), with s replaced by —s. This procedure gives the (bilateral) Laplace transform of x(t). 


Since x(t) and x2(—t) are both causal, X4(s) and X2(—s) are both unilateral Laplace transforms. Let 0,1 and O¢2 be the abscissas of convergence 


of X4(s) and X2(—s), respectively. This statement implies that X; (s) exists for all s with Re s > 0,4, and X2(—S) exists for all s with Re s > O¢o. 


Therefore, X> (s) exists for all s with Res < Cog! tT], Therefore, X (s) = X4(S)+X2(s) exists for all s such that 
Ou < Res < —o,2 


The regions of convergence (or existence) of X; (s), X2(s), and X(s) are shown in Fig. 4.53. Because X(s) is finite for all values of s lying in the strip 
of convergence (0,1 < Re S < —G¢2), poles of X (s) must lie outside this strip. The poles of X(s) arising from the causal component x; (tf) lie to the 
left of the strip (region) of convergence, and those arising from its anticausal component x(t) lie to its right (see Fig. 4.53). This fact is of crucial 
importance in finding the inverse bilateral transform. 


Region of convergence for causal component of x(t) 


— 
Region of convergence for anticausal component of x(f) 


\ 


— 


Region (strip) of convergence for the entire x(f) 
Figure 4.53 
This result can be generalized to left-sided and right-sided signals. We define a signal x(t) as a right-sided signal if x(t) = 0 for t < T; for some finite 


positive or negative number T,. A causal signal is always a right-sided signal, but the converse is not necessarily true. A signal is said to /eft sided if 
it is zero for t > T> for some finite, positive, or negative number To. 


An anticausal signal is always a left-sided signal, but the converse is not necessarily true. A two-sided signal is of infinite duration on both positive 
and negative sides of t and is neither right sided nor left sided. 


We can show that the conclusions for ROC for causal signals also hold for right-sided signals, and those for anticausal signals hold for left-sided 
signals. In other words, if x(t) is causal or right-sided, the poles of X(s) lie to the left of the ROC, and if x(t) is anticausal or left-sided, the poles of 
X(s) lie to the right of the ROC. 


To prove this generalization, we observe that a right-sided signal can be expressed as x(t) + x(t), where x(t) is a causal signal and x;(t) is some 


finite-duration signal. ROC of any finite-duration signal is the entire s-plane (no finite poles). Hence, the ROC of the right-sided signal x(t) + x(t) is 
the region common to the ROCs of x(t) and x;(t), which is same as the ROC for x(t). This proves the generalization for right-sided signals. We can 


use a similar argument to generalize the result for left-sided signals. 
Let us find the bilateral Laplace transform of 


x(t) =e u(—t) + e“ ut) (4.94) 


We already know the Laplace transform of the causal component 


e"ull) — Res >a (4,95) 


S'— ff 


For the anticausal component, x2(t) = etu(—t), we have 


| 

bi 
X2(-t) = i= — Res > —b 
o(—t) =e “ u(t) Pas es> 
so that 

| —] 
X2(s) = ———- = Res <b 
2{S) aa eee es < 
Therefore 


s—D 


e'u(—t) <> Res <b (4.96) 


and the Laplace transform of x(t) in Eq. (4.94) is 


| 
Fw weet Res >a and Res <b 
s-b s—a 
a-b 


a a<Res <b (4.97) 
(s — b)\(s —a) 


Figure 4.54 shows x(t) and the ROC of X(s) for various values of a and b. Equation (4.97) indicates that the ROC of X(s) does not exist if a > b, 
which is precisely the case in Fig. 4.54g. 


Figure 4.54 


Observe that the poles of X (s) are outside (on the edges) of the ROC. The poles of X (s) because of the anticausal component of x(t) lie to the 
right of the ROC, and those due to the causal component of x(f) lie to its left. 


When X(s) is expressed as a sum of several terms, the ROC for X(s) is the intersection of (region common to) the ROCs of all the terms. In general, 

if x(t) = =*;-4 x,(t), then the ROC for X(s) is the intersection of the ROCs (region common to all ROCs) for the transforms X;(s), X2(s),....X;(S)- 

pee Ss a 

Find the inverse Laplace transform of 

X(s) = —————_ 
(s + 2)(s —1) 


if the ROC is 


a. -2<Res<1 


b. Res>1 


Now, X(s) has poles at —2 and 1. The strip of convergence is —2 < Re s < 1. The pole at —2, being to the left of the strip of 
convergence, corresponds to the causal signal. The pole at 1, being to the right of the strip of convergence, corresponds to the 
anticausal signal. Equations (4.95) and (4.96) yield 


x(t) =e" u(t) + e'u(—-1) 

b. Both poles lie to the left of the ROC, so both poles correspond to causal signals. Therefore 
x(t) = (e™ — u(t) 

c. Both poles lie to the right of the region of convergence, so both poles correspond to anticausal signals, and 
x(t) = (-e™ +e )u(—1) 


Figure 4.55 shows the three inverse transforms corresponding to the same X (s) but with different regions of convergence. 


ib) fe) 


Figure 4.55: Three possible inverse transforms of —3/((s + 2)(s —1)). 


4.11-1 Properties of Bilateral Laplace Transform 


Properties of the bilateral Laplace transform are similar to those of the unilateral transform. We shall merely state the properties here without proofs. 
Let the ROC of X(s) be a < Re s < b. Similarly, let the ROC of X; (s) is aj < Re s < 6; for (i= 1, 2). 


LINEARITY - 
Gy Xi (0) + aaX2(t) <> a, X18) + a2 X2(5) 
The ROC for a4 X4 (s) + a2X2(s) is the region common to (intersection of) the ROCs for X1 (s) and X9(s). 


TIME SHIFT 


x(t —T) <= X(s)e7" 


The ROC for X(s)e ST is identical to the ROC for X(s). 


FREQUENCY SHIFT 
x(ne <> X(s — 50) 
The ROC for X(s — Sg) is a+ c<Res<b+c, where c= Re Spo. 
TIME DIFFERENTIATION 
dx(t) 
dt 


The ROC for sX (s) contains the ROC for X(s) and may be larger than that of X(s) under certain conditions [e.g., if X(s) has a first-order pole at s = 
0 that is canceled by the factor s in sX(s)]. 


<=> sX(s) 


TIME INTEGRATION 
i 
if x(t)dr <— > X(s)/s 


~~ 


The ROC for sX(s) is max (a, 0) < Res <b. 


TIME SCALING 
1 Ss 
x(pt)h— —X (=) 
P IB| \B 


The ROC for X (s/B) is Ba < Re s < Bb. For B > 1, x(Bt) represents time compression and the corresponding ROC expands by factor B. For 0 > B > 
1, x(Bt) represents time expansion and the corresponding ROC is compressed by factor B. 


TIME CONVOLUTION _ 

X1(t) & X2(1) <> Xi (5) Xa2(5) 

The ROC for X4(S)X2(s) is the region common to (intersection of) the ROCs for X4(s) and X2(s). 
FREQUENCY CONVOLUTION 


l c+ joo 
X(Hxt) —S ; 7 X,(w)X2(s — w) dw 


io c— joo 


The ROC for X4 (s) * X2(s) is a1 + ag < Res < by + bo. 


TIME REVERSAL | 
x(—t) —> X(-s) 


The ROC for X(—s) is -b < Res <-—a. 


4.11-2 Using the Bilateral Transform for Linear System Analysis 


Since the bilateral Laplace transform can handle noncausal signals, we can analyze noncausal LTIC systems using the bilateral Laplace transform. 
We have shown that the (zero-state) output y(t) is given by 


y(t) = £"[X(s)H(s)] (4.98) 


This expression is valid only if X(s)H(s) exists. The ROC of X(s)H(s) is the region in which both X (s) and H (s) exist. In other words, the ROC of 
X(s)H (s) is the region common to the regions of convergence of both X(s) and H(s). These ideas are clarified in the following examples. 


EXAMPLE 4.29 


Find the current y(t) for the RC circuit in Fig. 4.56a if the voltage x(t) is 
> . 
x(t) = e'u(t) +e" u(-) 


ui) 


nm 
tw 


(b) (c} 
Figure 4.56: Response of a circuit to a noncausal input. 


The transfer function H(s) of the circuit is given by 


Bt): = Res > —1 
s+1 
Because /(t) is a causal function, the ROC of H(s) is Re s > —1. Next, the bilateral Laplace transform of x (ft) is given by 
1 1 —1 
X(s) = — C= 1<Res <2 


s-l s-—2 (s—1)(s —2) 


The response y(t) is the inverse transform of X(s)H(s) 


—§ 
y(t) = £) | _________—. 
’ (s +1)(s —1)(s —2) 
-cf! 1 } i 2 = 
om 6s+1 2s-1 3#~2 


The ROC of X(s)H(s) is that ROC common to both X(s) and H(s). This is 1 < Re s < 2. The poles s = +1 lie to the left of the ROC and, therefore, 
correspond to causal signals; the pole s = 2 lies to the right of the ROC and thus represents an anticausal signal. Hence 


y(t) = de'u(t) + deu(t) + Fe%u(—t) 

Figure 4.56c shows y(t). Note that in this example, if 
‘ 

x(t) = e“u(t) +e u(-1) 


then the ROC of X(s) is —4 < Re s < —2. Here no region of convergence exists for X(s)H(s). Such a situation means that the dominance condition 
cannot be satisfied by any permissible value of s in the range (1 < Re s < 2). Hence, the response y(t) goes to infinity. 


EXAMPLE 4.30 


Find the response y(t) of a noncausal system with the transfer function 


His) = stat Res < 1 
s—1 

to the input x(t) = et u(t). 

We have 


| 
X(s) = 


s+2 


Res > —2 


and 


—1 
(s — 1)(s +2) 
The ROC of X(s)H(s) is the region —2 < Re s < 1. By partial fraction expansion 
—1/3 1/3 


fiiji— 
fae ee ea 


Y(s) = X(s)H(s) = 


—2< Res <1 


and 
y(t) = 4fe'u(—t) + e-*u(t)] 


Note that the pole of H(s) lies in the RHP at 1. Yet the system is not unstable. The pole(s) in the RHP may indicate instability or noncausality, 
depending on its location with respect to the region of convergence of H(s). For example, if H(s) = —1/(s — 1) with Re s > 1, the system is causal 


and unstable, with h(t) = —e! u(t). In contrast, if H(s) = —1/(s —1) with Re s < 1, the system is noncausal and stable, with h(t) = efu(—t). 


EXAMPLE 4.31 


His) = Res > —5 


ao 
and the input 
x(t) = eu(t) +e" u(-2) 


The input x(t) is of the type depicted in Fig. 4.54g, and the region of convergence for X(s) does not exist. In this case, we must determine separately 
the system response to each of the two input components, x,(t) = e'u(t) and x9(t) = e ly(—t). 


I 
N= TF Res > —1 
ees els 
X2(8) = 35 Res < —2 
If y; (t) and y2(t) are the system responses to x, (t) and x(t), respectively, then 
l 
Y¥,(s) = ——————— Res > —1 
a (s + 1)(s +5) 
14 1/4 
stl st+5 
so that 


y(t) = 3(e* —e*)u(t) 


and 
—l 
FE ees) ee Bag 
(s +2)(s +5) . 
_-1/3 , 13 
go get § 
so that 


yo(t) = 4fe-*u(—t) +e *u(t)] 
Therefore _ 
y(t) = y(t) + y2(t) 
= be-*u(-t) + (Je* + Be) ult) 


[tlFor instance, if x(t) exists for all t > 10, then x(—d), its time-inverted form, exists for tf < — 10. 


4.12 SUMMARY 


This chapter discusses analysis of LTIC (linear, time-invariant, continuous-time) systems by the Laplace transform, which transforms integro- 
differential equations of such systems into algebraic equations. Therefore solving these integro-differential equations reduces to solving algebraic 
equations. The Laplace transform method cannot be used for time-varying-parameter systems or for nonlinear systems in general. 


The transfer function H(s) of an LTIC system is the Laplace transform of its impulse response. It may also be defined as a ratio of the Laplace 
transform of the output to the Laplace transform of the input when all initial conditions are zero (system in zero state). If X(s) is the Laplace 
transform of the input x(t) and Y(s) is the Laplace transform of the corresponding output y(t) (when all initial conditions are zero), then Y(s) = 


X(s)H(s). For an LTIC system described by an Nth-order differential equation Q(D)y(t) = P(D)x(t), the transfer function H(s) = P(s)/Q(s). Like the 
impulse response h(t), the transfer function H(s) is also an external description of the system. 


Electrical circuit analysis can also be carried out by using a transformed circuit method, in which all signals (voltages and currents) are represented 
by their Laplace transforms, all elements by their impedances (or admittances), and initial conditions by their equivalent sources (initial condition 
generators). In this method, a network can be analyzed as if it were a resistive circuit. 


Large systems can be depicted by suitably interconnected subsystems represented by blocks. Each subsystem, being a smaller system, can be 
readily analyzed and represented by its input-output relationship, such as its transfer function. Analysis of large systems can be carried out with the 
knowledge of input-output relationships of its subsystems and the nature of interconnection of various subsystems. 


LTIC systems can be realized by scalar multipliers, adders, and integrators. A given transfer function can be synthesized in many different ways, 
such as canonic, cascade, and parallel. Moreover, every realization has a transpose, which also has the same transfer function. In practice, all the 
building blocks (scalar multipliers, adders, and integrators) can be obtained from operational amplifiers. 


The system response to an everlasting exponential e* is also an everlasting exponential H(s)e*, Consequently, the system response to an 


everlasting exponential lt ig H(juo) ef", Hence, H(jw) is the frequency response of the system. For a sinusoidal input of unit amplitude and having 
frequency w, the system response is also a sinusoid of the same frequency (w) with amplitude |H(jw)|, and its phase is shifted by ZH(jw) with 
respect to the input sinusoid. For this reason |H(jw)| is called the amplitude response (gain) and 4H(jw) is called the phase response of the system. 
Amplitude and phase response of a system indicate the filtering characteristics of the system. The general nature of the filtering characteristics of a 
system can be quickly determined from a knowledge of the location of poles and zeros of the system transfer function. 


Most of the input signals and practical systems are causal. Consequently we are required most of the time to deal with causal signals. When all 
signals must be causal, the Laplace transform analysis is greatly simplified; the region of convergence of a signal becomes irrelevant to the analysis 
process. This special case of the Laplace transform (which is restricted to causal signals) is called the unilateral Laplace transform. Much of the 
chapter deals with this variety of Laplace transform. Section 4.11 discusses the general Laplace transform (the bilateral Laplace transform), which 
can handle causal and noncausal signals and systems. In the bilateral transform, the inverse transform of X(s) is not unique but depends on the 
region of convergence of X(s). Thus the region of convergence plays a very crucial role in the bilateral Laplace transform. 
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MATLAB SESSION 4: CONTINUOUS-TIME FILTERS 


Continuous-time filters are essential to many if not most engineering systems, and MATLAB is an excellent assistant for filter design and analysis. 
Although a comprehensive treatment of continuous-time filter techniques is outside the scope of this book, quality filters can be designed and realized 
with minimal additional theory. 


A simple yet practical example demonstrates basic filtering concepts. Telephone voice signals are often lowpass-filtered to eliminate frequencies 
above a cutoff of 3 kHz, or W, = 3000(2TT) = 18.850 rad/s. Filtering maintains satisfactory speech quality and reduces signal bandwidth, thereby 
increasing the phone company 's call capacity. How, then, do we design and realize an acceptable 3 kHz lowpass filter? 


M4.1 Frequency Response and Polynomial Evaluation 


Magnitude response plots help assess a filter 's performance and quality. The magnitude response of an ideal filter is a brick-wall function with unity 
passband gain and perfect stopband attenuation. For a lowpass filter with cutoff frequency We, the ideal magnitude response is 


; l 
| Hidcai(j@)| _ fi 


|o| < @, 


|@| > aw, 


Unfortunately, ideal filters cannot be implemented in practice. Realizable filters require compromises, although good designs will closely approximate 
the desired brick-wall response. 


A realizable LTIC system often has a rational transfer function that is represented in the s-domain as 


M 
M—k 
— ¥(s) Bs) 2, bew—us 


~ X(s) As) ~ * y 
aysX-* 


Frequency response H(jw) is obtained by letting s = jw, where frequency w is in radians per second. 


H(s) 


MATLAB is ideally suited to evaluate frequency response functions. Defining a length-(N + 1) coefficient vector A = [ao, a4,...,a@y] and a length-(M + 
1) coefficient vector B = [by-yy, by-jy+t.--.On], program MS4P1 computes H(jw) for each frequency in the input vector w. 


function [H] = MS4P1(B,A,omega) ; 
SMS4P1.m : MATLAB Session 4, Program 1 
Function M-file computers frequency response for LTIC system 
INPUTS: B = vector of feedforward coefficients 
A = vector of feedback coefficients 
omega =vector of frequencies [rad/s]. 
OUTPUTS: H = frequency response 


AP JP oP aN al? 


aa 


= polyval (B,j*omega) ./polyval (A, j*omega) ; 


The function polyval efficiently evaluates simple polynomials and makes the program nearly trivial. For example, when A is the vector of 
coefficients [ag,a4,...,ay), polyval (A, j * omega) computes 


N ° 
So a(jo)” . 
k=0 


for each value of the frequency vector omega. It is also possible to compute frequency responses by using the signal processing toolbox function 
freqs. 


M4.2 Design and Evaluation of a Simple RC Filter 


One of the simplest lowpass filters is realized by using the RC circuit shown in Fig. M4.1. This one-pole system has transfer function Hrc(s) = (RCs 


+ 1)! and magnitude response |Hrc(jJ@)| = |(J@RC + 1) ‘| = 1/V¥1+(RCa@)*, Independent of component values R and C, this 


magnitude function possesses many desirable characteristics such as a gain that is unity at w = 0 and that monotonically decreases to zero as w — 
oO. 


Figure M4.1: An RC filter. 


Components R and C are chosen to set the desired 3 kHz cutoff frequency. For many filter types, the cutoff frequency corresponds to the half-power 
point, or |Hpc (jWe) | = 1/\/2. Assigning C a realistic capacitance of 1 nF, the required resistance is computed by 


R=1//C*w? 1/,/00 (27 3000), 


>> omega_c = 2-pi*3000; 

>> C = le-9; 

>> R = 1/sqrt(C*2*omega_c%2) 
R = 5.3052e+004 ~ 


The root of this first-order RC filter is directly related to the cutoff frequency, \ = —1/RC = —18,850 = —We. 


To evaluate the RC filter performance, the magnitude response is plotted over the mostly audible frequency range (0 < f 20 kHz). 
>> £ = linspace(0,20000,200); 


>> B= 1; A = [R*C 1]; Hmag_ RC = abs (MS4P1(B,A,£*2*pi) ); 
>> plot(f,abs(f£*2*pi)<=omega_c, 'k-', f£, Hmag_RC, 'k0OO '); 
>> xlabel ( 'f [Hz] '); ylabel( '|H {RC} (32/pi f)| '); 


>> axis([0 20000 - 0.05 1.05]); legend( 'Ideal ',, 'First-Order RC '); 
The linspace (XI, X2, N) command generates an N-length vector of linearly spaced points between X1 and x2. 


As shown in Fig. M4.2, the first-order RC response is indeed lowpass with a half-power cutoff frequency equal to 3 kHz. It rather poorly 
approximates the desired brick-wall response: the passband is not very flat, and stopband attenuation increases very slowly to less than 20 dB at 20 
kHz. 
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Figure M4.2: First-order RC magnitude response |Hpc(/2Ttf)|. 


M4.3 A Cascaded RC Filter and Polynomial Expansion 


A first-order RC filter is destined for poor performance; one pole is simply insufficient to obtain good results. A cascade of RC circuits increases the 
number of poles and improves the filter response. To simplify the analysis and prevent loading between stages, op-amp followers buffer the output of 
each section as shown in Fig. M4.3.A ou of N stages results in an Nth-order filter with transfer function given by 


Heasease(S) = (Hpc(s))* = (RCs + 1) 


cto Oh one 


xf} vir} 


Figure a A cascaded RC filter. 


Upon choosing a cascade of 10 sections and C = 1 nF, a 3 kHz cutoff frequency is obtained by setting 
R = J27 —1/(Ca,) = V2 —1/(62(10)~), 


>> R = sqrt (2* (1/10) -1) / (C*omega_c) 
R = 1.4213e+004 


This cascaded filter has a 10th-order pole at A = —1/RC and no finite zeros. To compute the magnitude response, polynomial coefficient vectors A 
and B are needed. Setting B = [1] ensures there are no finite zeros or, equivalently, that all zeros are at infinity. The poly command, which expands 
a vector of roots into a corresponding vector of polynomial coefficients, is used to obtain A. 


>> B= 1; A = poly(-1/(R*C) *ones(10,1));A = A/A(end) ; 
>> Hmag_cascade = abs (MS4P1(B,A,£*2*pi)); 


Notice that scaling a polynomial by a constant does not change its roots. Conversely, the roots of a polynomial specify a polynomial within a scale 
factor. The command A = A/A (end) properly scales the denominator polynomial to ensure unity gain at w = 0. 


The magnitude response plot of the cascaded RC filter is included in Fig. M4.4. The passband remains relatively unchanged, but stopband 
attenuation is greatly improved to over 60 dB at 20 kHz. 
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Figure M4.4: Lowpass filter comparison. 


M4.4 Butterworth Filters and the Find Command 


The pole location of a first-order lowpass filter is necessarily fixed by the cutoff frequency. There is little reason, however, to place all the poles of a 
10th-order filter at one location. Better pole placement will improve our filter 's magnitude response. One strategy, discussed in Section 4.10, is to 
place a wall of poles opposite the passband frequencies. A semicircular wall of poles leads to the Butterworth family of filters, and a semielliptical 
shape leads to the Chebyshev family of filters. Butterworth filters are considered first. 


To begin, notice that a transfer function H(s) with real coefficients has a squared magnitude response given by |H(juo)|2 = H(juw)H*(joo) = 
H(jw)H(—jod) = H(s)—s)|s=jw- Thus, half the poles of |H(jw)|? correspond to the filter H(s) and the other half correspond to H(—s). Filters that are 
both stable and causal require H(s) to include only left-half-plane poles. 


The squared magnitude response of a Butterworth filter is 


I 
Ha (jo)? = 
|Ha(Jo)| 1+ (j@/ ja," 


This function has the same appealing characteristics as the first-order RC filter: a gain that is unity at w = 0 and monotonically decreases to zero as 
Ww — oo. By construction, the half-power gain occurs at w,. Perhaps most importantly, however, the first 2N — 1 derivatives of |Hp(jw)| with respect 
to w are zero at w = 0. Put another way, the passband is constrained to be very flat for low frequencies. For this reason, Butterworth filters are 


sometimes called maximally flat filters. 

As discussed in MATLAB Session B, the roots of minus one must lie equally spaced on a circle centered at the origin. Thus, the 2N poles of 
|Hp(jus)|2 naturally lie equally spaced on a circle of radius w, centered at the origin. Figure M4.5 displays the 20 poles corresponding to the case N 
= 10 and we, = 3000(2TT) rad/s. An Nth-order Butterworth filter that is both causal and stable uses the N left-half-plane poles of |Hp(jw)|2. 
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Figure M4.5: Roots of |Hp(juo)|2 for N = 10 and Ww, = 3000(2TT). 


To design a 10th-order Butterworth filter, we first compute the 20 poles of |Hp(jw)|?: 


>> N=10; 
>> poles = roots([(j*omega_c)*(-2*N), zeros(1,2*N-1),1]); 


The find command is an extremely powerful function that returns the indices of a vector 's nonzero elements. Combined with relational operators, 
the find command allows us to extract the 10 left-half-plane roots that correspond to the poles of our Butterworth filter. 


>> B_ poles = poles (find(real(poles) <0O)); 


To compute the magnitude response, these roots are converted to coefficient vector A. 


>> A = poly (B poles); A = A/A (end); 
>> Hmag_B = abs (MS4P1 (B,A,f£*2*pi)); 


The magnitude response plot of the Butterworth filter is included in Fig. M4.4. The Butterworth response closely approximates the brick-wall function 
and provides excellent filter characteristics: flat passband, rapid transition to the stopband, and excellent stopband attenuation (>40dB at 5kHz). 


M4.5 Using Cascaded Second-Order Sections for Butterworth Filter Realization 


For our RC filters, realization preceded design. For our Butterworth filter, however, design has preceded realization. For our Butterworth filter to be 
useful, we must be able to implement it. 


Since the transfer function Hg(s) is known, the differential equation is also known. Therefore, it is possible to try to implement the design by using 
Op-amp integrators, summers, and scalar multipliers. Unfortunately, this approach will not work well. To understand why, consider the denominator 
coefficients ag = 1.766 x 10743 and a19 = 1. The smallest coefficient is 43 orders of magnitude smaller than the largest coefficient! It is practically 
impossible to accurately realize such a broad range in scale values. To understand this, skeptics should try to find realistic resistors such that R;/R = 


1.766 x 10743. Additionally, small component variations will cause large changes in actual pole location. 


A better approach is to cascade five second-order sections, where each section implements one complex conjugate pair of poles. By pairing poles in 
complex conjugate pairs, each of the resulting second-order sections have real coefficients. With this approach, the smallest coefficients are only 


about nine orders of magnitude smaller than the largest coefficients. Furthermore, pole placement is typically less sensitive to component variations 
for cascaded structures. 


The Sallen-Key circuit shown in Fig. M4.6 provides a good way to realize a pair of complex-conjugate poles.[T] The transfer function of this circuit is 
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Figure M4.6: Sallen-Key filter stage. 


Geometrically, Wo is the distance from the origin to the poles and Q = 1/2 cos w, where w is the angle between the negative real axis and the pole. 


Termed the "quality factor" of a circuit, Q provides a measure of the peakedness of the response. High-Q filters have poles close to the w axis, 
which boost the magnitude response near those frequencies. 


Although many ways exist to determine suitable component values, a simple method is to assign R, a realistic value and then let Ro = Ry, Cy = 
2Q/WoR 4 and Co = 1/2QW aR. Butter-worth poles are a distance WwW, from the origin, SO Wo = We. For our 10th-order Butterworth filter, the angles 
W are regularly spaced at 9, 27, 45, 63, and 81 degrees. MATLAB program MS4P2 automates the task of computing component values and 
magnitude responses for each stage. 


MS4P2.m : MATLAB Session 4, Program 2 
Script M-file computes Sallen---Key component values and magnitude 
responses for each of the five cascaded second-order filter sections. 


AP al ol? 


2 


omega 0 = 3000*2*pi; %& Filter cut---off frequency 


psi = [9 27 45 63 81]*pi/180; % Butterworth pole angles 

f = linspace(0, 6000, 200); % Frequency range for magnitude response calculations 
Hmag SK = zeros(5,200); % Pre-allocate array for magnitude responses 

for stage = 1:5, 

Q = 1/(2* cos(psi(stage))); % Compute Q for current stage 

% Compute and display filter components to the screen: 

disp([ 'Stage ',num2str(stage),... 

" (9 = ',num2str(Q),... 

"): Rl = R2 = ',num2str(56000),... 

'", Cl = ' ,num2str (2*Q/ (omega_0*56000) te “pasate 

', C2 = ' ,num2str (1/(2*Q*omega_0*56000) ) ] ) ; 

B = omega _0*°2; A = [1 omega_0/Q omega_0*%2] ; % Compute filter coefficients 
Hmag_SK(stage,:) = abs(MS4P1(B, A, 2*pi*f)); % Compute magnitude response 
end 

plot (f, Hmag_SK, 


k ', £, prod (Hmag_ SK), 'k: ') 


v 
xlabel ( 'f [Hz] ') ylabel ( 'Magnitude Response ') 


The disp command displays a character string to the screen. Character strings must be enclosed in single quotation marks. The num2str 
command converts numbers to character strings and facilitates the formatted display of information. The prod command multiplies along the columns 
of a matrix; it computes the total magnitude response as the product of the magnitude responses of the five stages. 


Executing the program produces the following output: 


>> MS4P2 

Stage 1 (Q = 0.50623): Rl = R2 = 56000, Cl = 9.5916e-010, C2 = 9.3569e-010 
Stage 2 (Q = 0.56116): Rl = R2 = 56000, Cl = 1.0632e-009, C2 = 8.441e-010 
Stage 3 (Q = 0.70711): Rl = R2 = 56000, Cl = 1.3398e-009, C2 = 6.6988e-010 
Stage 4 (Q = 1.1013): R1 = R2 = 56000, Cl = 2.0867e-009, C2 = 4.3009e-010 
Stage 5 (Q = 3.1962): R1 = R2 = 56000, Cl = 6.0559e-009, C2 = 1.482e-010 


Since all the component values are practical, this filter is possible to implement. Figure M4.7 displays the magnitude responses for all five stages 
(solid lines). The total response (dotted line) confirms a 10th-order Butterworth response. Stage 5, which has the largest Q and implements the pair 
of conjugate poles nearest the w axis, is the most peaked response. Stage 1, which has the smallest Q and implements the pair of conjugate poles 
furthest from the w axis, is the least peaked response. In practice, it is best to order high-Q stages last; this reduces the risk of the high gains 
saturating the filter hardware. 
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Figure M4.7: Magnitude responses for Sallen-Key filter stages. 


M4.6 Chebyshev Filters 


Like an order-N Butterworth lowpass filter (LPF), an order-N Chebyshev LPF is an all-pole filter that possesses many desirable characteristics. 
Compared with an equal-order Butterworth filter, the Chebyshev filter achieves better stopband attenuation and reduced transition band width by 
allowing an adjustable amount of ripple within the passband. 


The squared magnitude response of a Chebyshev filter is 

| H ( jo)|? i nnEECaprer EEE 
1 + €2Ci(w/w,) 

where € controls the passband ripple, C,(w/w,) is a degree-N Chebyshev polynomial, and Ww, is the radian cutoff frequency. Several characteristics 


of Chebyshev LPFs are noteworthy: 


» An order-N Chebyshev LPF is equiripple in the passband (|w] < W,), has a total of N maxima and minima over (0 < W < We), and is 
monotonic decreasing in the stopband (|w| > Ww ). 


« In the passband, the maximum gain is 1 and the minimum gain is 1/V1+ ¢7 For oddvalued N, |H(j0)| = 1. For even-valued 


|H(j0)| = 1/V1 + €*, 


» Ripple is controlled by setting € = V 10" 10 _ 1, where R is the allowable passband ripple expressed in decibels. Reducing € 
adversely affects filter performance (see Prob. 4.M-8). 


» Unlike Butterworth filters, the cutoff frequency Ww, rarely specifies the 3 dB point. For € + 1, |H(jw,)|? =1/(1 + €?) + 0.5. The cutoff 
frequency Ww, simply indicates the frequency after which |H(ja@)| < 1/V1+ €7 


The Chebyshev polynomial Cpj(x) is defined as 
Cx(x) = cos[N cos '(x)] = cosh[N cosh”! (x)] 


In this form, it is difficult to verify that Cp(x) is a degree-N polynomial in x. A recursive form of Cj(x) makes this fact more clear (see Prob. 4.M-11). 


Cy(x) = 2xCy_i(x) — Cy_2(x) 


With Co(x) = 1 and C4(x) = x, the recursive form shows that any Cy is a linear combination of degree-N polynomials and is therefore a degree-N 
polynomial itself. For N > 2, MATLAB program MS4P3 generates the (N + 1) coefficients of Chebyshev polynomial Cjy(x). 


function [C N] = MS4P3 (N); 

MS4P3 .m : MATLAB Session 4, Program 3 

Function M-file computes Chebyshev polynomial coefficients 

using the recursion relation C_N(x) = 2xC_{N- 1} (x) - C_{N-2} (x) 
INPUTS: N = degree of Chebyshev polynomial 

OUTPUTS: C_N = vector of Chebyshev polynomial coefficients 


AP Al oP al ol? 


C Nm2 = 1; C Nml = [1 O]; % Initial polynomial coefficients: 

for t = 2:N; 

CN =2*conv([{1l 0], C Nml) - [zeros (1, length (C _Nml1) - length(C Nm2) + 1), C Nm2]; 
C_Nm2 = C_Nm1; C_Nml = C_N; ~ ~ a 

end 


As examples, consider Co(x) = 2xC4(x) — Co(x) = 2x(x) — 1 = 2x? — 1 and C3(x) = 2xCo(x) — C4(x) = 2x(2x* — 1) — x = 4x3 = 3x. MS4P3 
easily confirms these cases. 

>> MS4P3 (2) 

ans = 2 0 -1 

>> MS4P3 (3) 

ans = 4 0 =3 0 


Since Cp(w/w,) is a degree-N polynomial, |H(juo)|? is an all-pole rational function with 2N finite poles. Similar to the Butterworth case, the N poles 


specifying a causal and stable Chebyshev filter can be found by selecting the N left-half plane roots of 1 + €2C2 af si(jw¢)].- 


Root locations and dc gain are sufficient to specify a Chebyshev filter for a given N and €. To demonstrate, consider the design of an order-8 
Chebyshev filter with cutoff frequency f, = 1 kHz and allowable passband ripple R = 1 dB. First, filter parameters are specified. 


>> omega_c = 2*pi*1000; R= 1 
>> epsilon = sqrt (10*(R/10)- 


The coefficients of Cy (s/(jw,)) are obtained with the help of MS4P3, and then the coefficients of (1 + €2C?a(s/(jwW)) are computed by using 
convolution to perform polynomial multiplication. 


>> CN MS4P3 (N).* ((1/ (j*omega_c)).* [N:-1:0]); 
>> CP epsilon*2*conv(CN, CN); CP(end) = CP (end) +1; 


Next, the polynomial roots are found, and the left-half-plane poles are retained and plotted. 


>> poles = roots(CP); i = find (real (poles) < 0); C_poles = poles (i); 
>> plot(real (C_poles),imag(C_poles), 'kx '); axis equal; 

>> axis(omega-c* [=1l<1 Led abe, Lely 

>> xlabel ( ' \sigma '); ylabel ( '\omega '); 


As shown in Fig. M4.8, the roots of a Chebyshev filter lie on an ellipselT] (see Prob. 4.M-12). 
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Figure M4.8: Pole-zero plot for an order-8 Chebyshev LPF with f, = 1 kHz and r= 1 dB. 


To compute the filter's magnitude response, the poles are expanded into a polynomial, the dc gain is set based on the even value of N, and MS4P1 
is used. 


>> A = poly (C poles); 

>> B = A (end)/7sqrt (l+tepsilon*2) ; 

>> omega = linspace(0,2*pi*2000,2001); 

>> H = MS4P1 (B, A, omega); 

>> plot (omega/2/pi,abs(H), 'k '); grid 

>> xlabel ( 'f [Hz] '); ylabel ( '|H (32\pi f)| '); 
>> axis([0 2000 0 1.1]); 


As seen in Fig. M4.9, the magnitude response exhibits correct Chebyshev filter characteristics: passband ripples are equal in height and never 
exceed R = 1 dB; there are a total of N = 8 maxima and minima in the passband; and the gain rapidly and monotonically decreases after the cutoff 
frequency of f, = 1 kHz. 
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Figure M4.9: Magnitude responses for an order-8 Chebyshev LPF with f, = 1 kHz and r= 1 dB. 


For higher-order filters, polynomial rooting may not provide reliable results. Fortunately, Chebyshev roots can also be determined analytically. For 
2k +1 I 1 
&=—x and &£=—sinh'| - 
2N N € 
the Chebyshev poles are 
Py = w, sinh (&) sin (Py) + jo, cosh (E) cos (Px) 


Continuing the same example, the poles are recomputed and again plotted. The result is identical to Fig. M4.8. 


>> k = [1:N]; xi = 1/N*asinh(1/epsilon); phi = (k*2-1)/(2*N)*pi; 
>> C_poles = omega_c* (-sinh (xi) *sin(phi)+j*cosh (xi) *cos (phi) ); 
>> plot(real(C_poles),imag(C_ poles), 'kx '); axis equal; 


>> axis(omega_c*[-1.1 1.1 -1.1 1.1]); 
>> xlabel( '\sigma '); ylabel( '\omega '); 


As in the case of high-order Butterworth filters, a cascade of second-order filter sections facilitates practical implementation of Chebyshev filters. 
Problems 4.M-3 and 4.M-6 use second-order Sallen-Key circuit stages to investigate such implementations. 


[tl more general version of the Sallen-Key circuit has a resistor R, from the negative terminal to ground and a resistor Ry between the negative 
terminal and the output. In Fig. M4.6, Rg = © and Rp = 0. 


[t]E. A. Guillemin demonstrates a wonderful relationship between the Chebyshev ellipse and the Butterworth circle in his book, Synthesis of Passive 
Networks (Wiley, New York, 1957). 


PROBLEMS 


4.1.1 By direct integration [Eq. (4.1)] find the Laplace transforms and the region of convergence of the following functions: 
a. u(t) — u(t — 1) 
b. te~fu(t) 
c. tcos Wot u(t) 
d. (e2! — 2e-'yu(t) 
e. cos Wt cos Wot u(t) 
f. cosh (at)u(t) 
g. sinh (at)u(t) 
h. e 2! cos (5t + 8)u(t) 


4.1.2 By direct integration find the Laplace transforms of the signals shown in Fig. P4.1-2. 


(a tb) (e) 


Figure P4.1-2 


4.1.3 Find the inverse (unilateral) Laplace transforms of the following functions: 


a. 
25+ 5 
s?+55+6 


3s +5 
s? +45 + 13 


(s + 1)? 
s?—s —6 


—_ 
s?(s + 2) 


2s+1 
(s + 1)(s? + 2s + 2) 


s+2 
s(s + 1)? 


1 
(s + 1)(s + 2)4 


s+l1 
s(s + 2)?(s? + 4s + 5) 


so 


(s + 1)?(s? + 2s + 5) 


4.2.1 Find the Laplace transforms of the following functions using only Table 4.1 and the time-shifting property (if needed) of the unilateral 
Laplace transform: 


a. u(t) — u(t — 1) 

b. e (= Yu(t — T) 

c. e (fut) 

d. efu(t — T) 

e. tetu(t — T) 

f. sin [wo(t — T)] u(t — T) 
g. sin [wWo(t — T)] u(t) 

h. sin wot u(t — T) 


4.2.2 Using only Table 4.1 and the time-shifting property, determine the Laplace transform of the signals in Fig. P4.1-2. [Hint: See Section 
1.4 for discussion of expressing such signals analytically.] 


4.2.3 Find the inverse Laplace transforms of the following functions: 


a. 
(2s + 5)e~4 
s? +55 +6 


se 42 
s?+2s4+2 


e FD 43 


s?—2s+5 
d. 
et +e%4+1 
s?+3s5+2 
4.2.4 The Laplace transform of a causal periodic signal can be determined from the knowledge of the Laplace transform of its first cycle 
(period). 
a. If the Laplace transform of x(t) in Fig. P4.2-4a is X (s), then show that G(s), the Laplace transform of g(t) (Fig. P4.2-4b), 
is 
X(s 
ee 3 Res >0 
1 — e-sh 


uff wf)! 


Figure P4.2-4 
b. Use this result to find the Laplace transform of the signal p(f) illustrated in Fig. P4.2-4c. 
4.2.5 Starting only with the fact that 5(t) <= 1, build pairs 2 through 10b in Table 4.1, using various properties of the Laplace transform. 
4.2.6 


a. Find the Laplace transform of the pulses in Fig. 4.2 in the text by using only the time-differentiation property, the time- 
shifting property, and the fact that 5(t) <= 1. 


b. In Example 4.7, the Laplace transform of x(t) is found by finding the Laplace transform of d?x/dt2. Find the Laplace 
transform of x(t) in that example by finding the Laplace transform of dx/dt and using Table 4.1, if necessary. 
4.2.7. Determine the inverse unilateral Laplace transform of 
1 s? 
X(s) = ———__—— 
et? (s + 1)(s + 2) 


4.2.8 — Since 13 is such a lucky number, determine the inverse Laplace transform of X(s) = 1(s+1)13 given region of convergence o > — 1. 
[Hint: What is the nth derivative of 1/(s + a)?] 


4.2.9 It is difficult to compute the Laplace transform X(s) of signal 
1 
x(t) = pt@ 
by using direct integration. Instead, properties provide a simpler method. 
a. Use Laplace transform properties to express the Laplace transform of tx(t) in terms of the unknown quantity X(s). 
b. Use the definition to determine the Laplace transform of y(t) = tx(t). 


c. Solve for X(s) by using the two pieces from a and b. Simplify your answer. 


4.3.1 Using the Laplace transform, solve the following differential equations: 


a. 
(D? + 3D + 2)y(t) = Dx(t) if yO~) = $7) =O and x(t) = u(t) 


(D? + 4D + 4)y(t) = (D + 1)x() iyO™) = 2, 90>) = Land x(t) = e~1u(t) 


Cc. 
(D? + 6D + 25) y(t) = (D + 2)x(1) if y(O~) = ¥O>) = Lang x(t) = 25u(t) 


4.3.2 Solve the differential equations in Prob. 4.3-1 using the Laplace transform. In each case determine the zero-input and zero-state 
components of the solution. 


4.3.3 Solve the following simultaneous differential equations using the Laplace transform, assuming all initial conditions to be zero and the 


input x(t) = u(t): 

a. (D + 3)y4(t) — 2ya(t)=x(t) — 2y1(t) + (2D + 4)y2(t) = 0 

b. (D+ 2)y4(t) — (D + 1)y2(t) = 0 — (D + 1)y4(t) + (2D + 1)y2(t)= x(t) 
Determine the transfer functions relating outputs y4(t) and y2(f) to the input x(t). 


4.3.4 For the circuit in Fig. P4.3-4, the switch is in open position for a long time before t = 0, when it is closed instantaneously. 


a. Write loop equations (in time domain) for t => 0. 
b. Solve for y4(t) and y2(t) by taking the Laplace transform of loop equations found in part (a). 


4.3.5 For each of the systems described by the following differential equations, find the system transfer function: 


a. 
d*y dy dx 
—— + LIS + My (1) = S— + Bt 
an at y® a x) 


FY 5 6A) 119 a byih 
—_— ——_ — Vv 
dp dt? dt ‘ 
d?x a: 


x 
= 3 + 7— + Sx(t 
a gp HOR 


as -y(tj= i — x(t) 


1=0 


Figure P4.3-4 


4.3.6 For each of the systems specified by the following transfer functions, find the differential equation relating the output y(t) to the input 
x(t) assuming that the systems are controllable and observable: 


a. 
s+5 
H “oe 
(s) 2435+8 
b. 
7 
$-+354+5 
ks) S56 ——— > 
8° + 8s? +5547 
Cc. 
5s? + 7s +2 
H(s) = ——_——_ 
s?—2s +5 
4.3.7 For a system with transfer function 
2s +3 
H(s) = ————— 
= ay 45 


a. Find the (zero-state) response for input x(t) of (i) 10u(t) and (ii) u(t — 5). 


b. For this system write the differential equation relating the output y(t) to the input x(t) assuming that the systems are 
controllable and observable. 


4.3.8 For a system with transfer function 


H(s) = —— 
sé +9 
a. Find the (zero-state) response if the input x(t) = (1 —e7')u(t) 
b. For this system write the differential equation relating the output y(t) to the input x(t) assuming that the systems are 
controllable and observable. 


4.3.9 For a system with transfer function 
s+5 
H(s) ee 
s?+55+6 


a. Find the (zero-state) response for the following values of input x(t): 
i. e u(t) 
i. e*tu(t) 
ii. e74(E-S)u(t — 5) 
iv. eA(t-5) u(t) 
v. e 4tu(t — 5) 
b. For this system write the differential equation relating the output y(t) to the input x(t) assuming that the systems are 
controllable and observable. 
4.3.10 AnLTI system has a step response given by s(f) = e- u(t) - e-2u(t). Determine the output of this system y(t) given an input x(t) = 
8(t—11)—cos (/3)u(t). 


4.3.11 For an LTIC system with zero initial conditions (system initially in zero state), if an input x(t) produces an output y(t), then using the 
Laplace transform show the following. 


a. The input dx/dt produces an output dy/dt. 


b. The input S% X(T) dT produces an output S' y(t) dt. Hence, show that the unit step response of a system is an 


integral of the impulse response; that is, S'p h(t) at. 


4.3.12 
a. Discuss asymptotic and BIBO stabilities for the systems described by the following transfer functions assuming that the 


systems are controllable and observable: 


(s +5) 
s? +3542 


s+5 
s?(s + 2) 
iii. 
s(s + 2) 
“st+5) 


s+5 
s(s +2) 


s+5 
s?—2s+3 


b. Repeat part (a) for systems described by the following differential equations. Systems may be uncontrollable and/or 
unobservable. 


i. (D2 + 3D + 2)y(t) = (D + 3)x(t) 
ii. (D2 + 3D + 2)y(t) = (D + 1)x(t) 
ii. (D2 + D — 2)y(t) = (D — 1)x(t) 


iv. (D2 — 3D + 2)y(t) = (D — 3)x(t) 


4.4.1 Find the zero-state response y(t) of the network in Fig. P4.4-1 if the input voltage x(t) = tetu(t). Find the transfer function relating 
the output y(t) to the input x(t). From the transfer function, write the differential equation relating y(t) to x(t). 


10 Le 


x(t) 


Figure P4.4-1 


4.4.2 The switch in the circuit of Fig. P4.4-2 is closed for a long time and then opened instantaneously at t = 0. Find and sketch the 
current y(t). 


1H 20 


Figure P4.4-2 


4.4.3 Find the current y(t) for the parallel resonant circuit in Fig. P4.4-3 if the input is 
a. x(t) =A cos Wot u(t) 
b. x(t) =A sin wot u(t) 
Assume all initial conditions to be zero and, in both cases, wo = 1/LC. 


MO 


x() eS tg 


Figure P4.4-3 


4.4.4 Find the loop currents y4 (t) and y2(t) for t= 0 in the circuit of Fig. P4.4-4a for the input x(t) in Fig. P4.4-4b. 


Figure P4.4-4 


4.4.5 For the network in Fig. P4.4-5 the switch is in a closed position for a long time before t = 0, when it is opened instantaneously. Find 
yi(t) and v,(t) for f => 0. 


yt) 2H yp) — 1H 


1O 
Figure P4.4-5 


4.4.6 Find the output voltage vo(t) for t = 0 for the circuit in Fig. P4.4-6, if the input x(t) = 100u(t). The system is in the zero state initially. 


1n 


x(t) 


Figure P4.4-6 


4.4.7 Find the output voltage y(t) for the network in Fig. P4.4-7 for the initial conditions i; (0) = 1 A and v,(0) = 3 V. 


Quit) 


Figure P4.4-7 


44.8 For the network in Fig. P4.4-8, the switch is in position a for a long time and then is moved to position b instantaneously at t = 0. 
Determine the current y(t) for t > 0. 


Figure P4.4-8 


4.4.9 Show that the transfer function that relates the output voltage y(t) to the input voltage x(t) for the op-amp circuit in Fig. P4.4-9a is 
given by 


A()= Bud where 
S+a 


and that the transfer function for the circuit in Fig. P4.4-9b is given by 


Ks 
H — 
ts) S+a 


fa) fb) 


Figure P4.4-9 


4.4.10 For the second-order op-amp circuit in Fig. P4.4-10, show that the transfer function H(s) relating the output voltage y(t) to the input 


voltage x(t) is given by 


—Ss 
H(s) = ———_——— 
@) s?+8s +12 


xn) f 


Figure P4.4-10 


4.4.11 
a. Using the initial and final value theorems, find the initial and final value of the zero-state response of a system with the 


transfer function 

6s? + 3s + 10 
ie 
2s? + 65 +5 


and the input (i) u(t) and (ii) e~fu(t). 


b. Find y(0*) and y() if Y(s) is given by 
i. 
s?+5s+6 
s?+3s+2 


s? + 4s? + 10s +7 
s? + 2s +3 
4.5.1 Figure P4.5-1a shows two resistive ladder segments. The transfer function of each segment (ratio of output to input voltage) is 1/2. 
Figure P4.5-1b shows these two segments connected in cascade. 


a. Is the transfer function (ratio of output to input voltage) of this cascaded network (1/2)(1/2) = 1/4? 


b. If your answer is affirmative, verify the answer by direct computation of the transfer function. Does this computation 
confirm the earlier value 1/4? If not, why? 


c. Repeat the problem with R3 = R4 = 20 kQ. Does this result suggest the answer to the problem in part (b)? 


fa) ib) 


Figure P4.5-1 


4.5.2 In communication channels, transmitted signal is propagated simultaneously by several paths of varying lengths. This causes the signal 
to reach the destination with varying time delays and varying gains. Such a system generally distorts the received signal. For error-free 
communication, it is necessary to undo this distortion as much as possible by using the system that is inverse of the channel model. 


For simplicity, let us assume that a signal is propagated by two paths whose time delays differ by T seconds. The channel over the 
intended path has a delay of T seconds and unity gain. The signal over the unintended path has a delay of 7 + T seconds and gain a. 
Such a channel can be modeled, as shown in Fig. P4.5-2. Find the inverse system transfer function to correct the delay distortion and 
show that the inverse system can be realized by a feedback system. The inverse system should be causal to be realizable. [Hint: We 
want to correct only the distortion caused by the relative delay T seconds. For distortionless transmission, the signal may be delayed. 
What is important is to maintain the shape of x(t). Thus a received signal of the form c x(t — T) is considered to be distortionless.] 


x(t) y(t) 
a Delay? -—>— _> 
Delay T + 7 a 


Figure P4.5-2 


4.5.3 


4.6.1 


4.6.2 


4.6.3 


4.6.4 


4.6.5 


4.6.6 


4.6.7 


4.6.8 


4.6.9 


4.6.10 


4.6.11 


4.6.12 


4.6.13 


Discuss BIBO stability of the feedback systems depicted in Fig. P4.5-3. For the case in Fig. P4.5-3b, consider three cases: 


i. K=10 
ii. K= 50 
iii, K = 48 
“) xn xt) wn 
Figure P4.5-3 
Realize 
Ht) = $(s + 2) 


(s+ Is + 3)(s + 4) 


by canonic direct, series, and parallel forms. 
Realize the transfer function in Prob. 4.6-1 by using the transposed form of the realizations found in Prob. 4.6-1. 


Repeat Prob. 4.6-1 for 


a. 
3s(s + 2) 
AW) = Cae +24D 
b. 
H(s) u-+ 


~ (s +2)(s? +4) 
Realize the transfer functions in Prob. 4.6-3 by using the transposed form of the realizations found in Prob. 4.6-3. 


Repeat Prob. 4.6-1 for 
2s +3 
H(s) = 


5s(s + 2)°(s + 3) 


Realize the transfer function in Prob. 4.6-5 by using the transposed form of the realizations found in Prob. 4.6-5. 


Repeat Prob. 4.6-1 for 
s(s + I(s+2 
H(s) = s(s + 1)(s + 2) 


(s + 5){s + 6)(s + 8) 
Realize the transfer function in Prob. 4.6-7 by using the transposed form of the realizations found in Prob. 4.6-7. 


Repeat Prob. 4.6-1 for 


s 
CO) 
©) = Gy D6+D643) 


Realize the transfer function in Prob. 4.6-9 by using the transposed form of the realizations found in Prob. 4.6-9. 
Repeat Prob. 4.6-1 for 


4G) = Cape +441) 


Realize the transfer function in Prob. 4.6-11 by using the transposed form of the realizations found in Prob. 4.6-11. 


In this problem we show how a pair of complex conjugate poles may be realized by using a cascade of two first-order transfer 
functions and feedback. Show that the transfer functions of the block diagrams in Fig. P4.6-13a and P4.6-13b are 


a. 


l 
(s +a)? +b? 
———. 
s? + 2as + (a? + b?) 


A(s).= 


S+a 
(sta)? +b? 
S+a 


Hence, show that the transfer function of the block diagram in Fig. P4.6-13c is 


H(s) = 


As +B 
(s +a)? +b? 
As +B 


H(s) = 


Figure P4.6-13 


4.6.14 | Show op-amp realizations of the following transfer functions: 


—10 
s+5 
ii. 
10 
s+5 
iii. 
S+2 
s+5 
4.6.15 Show two different op-amp circuit realizations of the transfer function 
$+2 3 
H(s) = ——_ = 1- - 
s+5 s+5 
4.6.16 | Show an op-amp canonic direct realization of the transfer function 
3s +7 
H(s) = ———— 
s?+4s+10 
4.6.17 | Show an op-amp canonic direct realization of the transfer function 
s?+5s+2 
H(s) —————— 
s*+4s +13 


4.7.1 Feedback can be used to increase (or decrease) the system bandwidth. Consider the system in Fig. P4.7-1a with transfer function 
G(s) = We/(S + We). 


a. Show that the 3 dB bandwidth of this system is Ww, and the dc gain is unity, that is, |H(j0)| = 1. 


b. To increase the bandwidth of this system, we use negative feedback with H(s) = 9, as depicted in Fig. P4.7-1b. Show 
that the 3 dB bandwidth of this system is 10wW,. What is the dc gain? 


c. To decrease the bandwidth of this system, we use positive feedback with H(s) = —0.9, as illustrated in Fig. P4.7-1c. 
Show that the 3 dB bandwidth of this system is w,/10. What is the dc gain? 


d. The system gain at dc times its 3 dB bandwidth is the gain-bandwidth product of a system. Show that this product is the 
same for all the three systems in Fig. P4.7-1. This result shows that if we increase the bandwidth, the gain decreases 
and vice versa. 


Figure P4.7-1 
4.8.1 For an LTIC system described by the transfer function 
s+2 
H(s) = ————_ 
s?+5s+4 


find the response to the following everlasting sinusoidal inputs: 
a. 5 cos (2t + 30°) 
b. 10 sin (2t + 45°) 
c. 10 cos (3t + 40°) 

Observe that these are everlasting sinusoids. 


4.8.2 For anLTIC system described by the transfer function 


s+3 
H(s) = —— 
(s) (s + 2)? 


find the steady-state system response to the following inputs: 
a. 10u(t) 
b. cos (2t + 60°)u(t) 
c. sin (3t — 45°)u(t) 


d. 3! u(t) 
4.8.3 For an allpass filter specified by the transfer function 
—(s — 10 
Hiya 
s+10 


find the system response to the following (everlasting) inputs: 
a. eft 
b. cos (wt + 8) 
c. cost 
d. sin 2t 
e. cos 10t 
f. cos 100¢ 

Comment on the filter response. 

4.8.4 The pole-zero plot of a second-order system H(s) is shown in Fig. P4.8-4. The dc response of this system is minus one, H(j0) = —1. 

a. Letting H(s) = k(s? + bys + b2)/(s? + a4s + az), determine the constants k, by, bz, a4, and ap. 


b. What is the output y(t) of this system in response to the input x(t) = 4 + cos (t/2 + 11/3)? 


tm 


@w 
oO 


tr 


2-15 -1 05 0 05 1 #415 
a 


Figure P4.8-4: System pole-zero plot. 


4.9.1. Sketch Bode plots for the following transfer functions: 


a. 
s(s + 100) 
(s + 2)(s + 20) 
b 


" (s + 10)(s + 20) 
s*(s + 100) 


(s + 10)(s + 200) 
(s + 20)?(s + 1000) 
4.9.2 Repeat Prob. 4.9-1 for 


a. 
3 
(s + 1)(s? + 4s + 16) 


5 
(s + 1)(s? + 14.148 + 100) 


(s + 10) 
s(s? + 14.145 + 100) 


4.9.3. Using the lowest order possible, determine a system function H(s) with real-valued roots that matches the frequency response in Fig. 
P4.9-3 Verify your answer with MATLAB. 


dh )—-+--——- +--+ 72g ++ 


Bode approximation 
Truc |H( jot 


HUjo (4B) 


10° 10° 10' 102 10° 10° 
oo (rad/s) 


Figure P4.9-3: Bode plot and frequency response for H(s). 


4.9.4 A graduate student recently implemented an analog phase lock loop (PLL) as part of his thesis. His PLL consists of four basic 
components: a phase/frequency detector, a charge pump, a loop filter, and a voltage-controlled oscillator. This problem considers only 
the loop filter, which is shown in Fig. P4.9-4a. The loop filter input is the current x(t), and the output is the voltage y(t). 


a. Derive the loop filter 's transfer function H(s). Express H(s) in standard form. 


b. Figure P4.9-4b provides four possible frequency response plots, labeled A through D. Each log-log plot is drawn to the 
same scale, and line slopes are either 20 dB/decade, 0 dB/decade, or —20 dB/decade. Clearly identify which plot(s), if 


any, could represent the loop filter. 


c. Holding the other components constant, what is the general effect of increasing the resistance R on the magnitude 
response for low-frequency inputs? 


d. Holding the other components constant, what is the general effect of increasing the resistance R on the magnitude 
response for high-frequency inputs? 


()—— C, 


(b) 
Figure P4.9-4: (a) Circuit diagram for PLL loop filter. (b) Possible magnitude response plots for PLL loop filter. 


4.10.1 Using the graphical method of Section 4.10-1, draw a rough sketch of the amplitude and phase response of an LTIC system 
described by the transfer function 


s* — 25+ 50 
H(s) = ——————_— 
() = 2525450 
_ = 7= Je -14+ I) 
~ (s+1— j7)(s +14 7) 
What kind of filter is this? 


4.10.2 Using the graphical method of Section 4.10-1, draw a rough sketch of the amplitude and phase response of LTIC systems whose 
polezero plots are shown in Fig. P4.10-2. 


5 plane 
P 


Im 


(a) (b) 


Figure P4.10-2 


4.10.3 Design a second-order bandpass filter with center frequency w = 10. The gain should be zero at w = 0 and at w = o. Select poles 
at —a + j/10. Leave your answer in terms of a. Explain the influence of a on the frequency response. 


4.10.4 The LTIC system described by H(s) = (s — 1)/(s + 1) has unity magnitude response |H(jw)| = 1. Positive Pat claims that the output 
y(t) of this system is equal the input x(t) since the system is allpass. Cynical Cynthia doesn 't think so. "This is signals and systems 
class," she complains. "It has to be more complicated!" Who is correct, Pat or Cynthia? Justify your answer. 


4.10.5 Two students, Amy and Jeff, disagree about an analog system function given by H1(s) = s. Sensible Jeff claims the system has a 


zero at s = 0. Rebellious Amy, however, notes that the system function can be rewritten as H;(s) = 1/s~| and claims that this 
implies a system pole at s = oo. Who is correct? Why? What are the poles and zeros of the system H(s) = 1/s? 


4.10.6 A rational transfer function H(s) is often used to represent an analog filter. Why must H(s) be strictly proper for lowpass and 
bandpass filters? Why must H(s) be proper for highpass and bandstop filters? 


4.10.7 For a given filter order N, why is the stopband attenuation rate of an all-pole lowpass filter better than filters with finite zeros? 


4.10.8 Is it possible, with real coefficients (({k. bi, b>. a1, 42] € R)), for a system 


S+hs +b, 
S* + @)\S + @ 


to function as a lowpass filter? Explain your answer. 


4.10.9 Nick recently built a simple second-order But-terworth lowpass filter for his home stereo. Although the system performs pretty well, 
Nick is an overachiever and hopes to improve the system performance. Unfortunately, Nick is pretty lazy and doesn 't want to 
design another filter. Thinking "twice the filtering gives twice the performance," he suggests filtering the audio signal not once but 
twice with a cascade of two identical filters. His overworked, underpaid signals professor is skeptical and states, "If you are using 
identical filters, it makes no difference whether you filter once or twice!" Who is correct? Why? 


4.10.10 | AnLTIC system impulse response is given by h(t) = u(t)-u(t — 1). 


a. Determine the transfer function H(s). Using H(s), determine and plot the magnitude response |H(jw)|. Which type of 
filter most accurately describes the behavior of this system: lowpass, highpass, bandpass, or bandstop? 


b. What are the poles and zeros of H(s)? Explain your answer. 


c. Can you determine the impulse response of the inverse system? If so, provide it. If not, suggest a method that could 
be used to approximate the impulse response of the inverse system. 


4.10.11. An ideal lowpass filter H_p(s) has magnitude response that is unity for low frequencies and zero for high frequencies. An ideal 
highpass filter Hyp(s) has an opposite magnitude response: zero for low frequencies and unity for high frequencies. A student 
suggests a possible lowpass-to-highpass filter transformation: Hyp(s) = 1 — H_p(s). In general, will this transformation work? 
Explain your answer. 

4.10.12 AnLTIC system has a rational transfer function H(s). When appropriate, assume that all initial conditions are zero. 

a. Is is possible for this system to output y(t) = sin (100Ttt) u(t) in response to an input x(t) = cos (100Trft)u(t)? Explain. 

b. Is is possible for this system to output y(t) = sin (100Trt)u(t) in response to an input x(t) = sin (5Otrt)u(t)? Explain. 

c. Is is possible for this system to output y(t) = sin (100Trf) in response to an input x(t) = cos (100Trf)? Explain. 

d. Is is possible for this system to output y(t) = sin (100TTf) in response to an input x(t) = sin (5Otrt)? Explain. 

4.11.1 Find the ROC, if it exists, of the (bilateral) Laplace transform of the following signals: 

a. etu(t) 
b. e—tu(t) 


Cc. 


4.11.2 Find the (bilateral) Laplace transform and the corresponding region of convergence for the following signals: 


a. etl 


b. e lél cos t 

c. el(t) + e2fu(—t) 

d. e—ftu(t) 

e. e— u(t) 

f. cos Wot u(t) + ef u(—t) 


4.11.3 Find the inverse (bilateral) Laplace transforms of the following functions: 


25+5 


—— es _9 
a. (s +2)(s +3) ieneheaiinn 


2s —5 
—_______ 2<0 <3 
b. (s — 2)(s — 3) — 
2s+3 
—_—_—_—_—_—_—- ao>-l 
c. (s + 1)(s + 2) 
99+3 
sol ao<-—2 


d. (s + 1)(s + 2) 


3s? — 25 — 17 
(s + 1)(s + 3)(s — 5) 


e. -leao<§ 


4.11.4 Find 


2s? — 2s — 6 


(s + 1)(s — 1)(s +2) 
if the ROC is 
a. Res>1 
b. Res<-2 
c. -1<Res<1 
d. —2<Res<-—1 
4.11.5 For a causal LTIC system having a transfer function H(s) = 1/(s + 1), find the output y(t) if the input x(t) is given by 


a. e ltl/2 


b. efu(t) + e2u(-t) 
c. e f2u(t) + e 4u(-t) 
d. e2fu(t) + efu(—t) 
e. e “4u(t) + eo 2u(—2) 
f. eStu(t) + e-2!u(—-2) 
4.11.6 The autocorrelation function r,,(t) of a signal x(t) is given by 


oO 
rat) =f x(r)x(t + t)dr 


oo 


Derive an expression for Rex(s) = L (rex (f)) in terms of X(s), where X(s) = £ (x(1)).. 
4.11.7 Determine the inverse Laplace transform of 
2h -a8 
given that the region of convergence is o < 0. 


4.11.8 An absolutely integrable signal x(t) has a pole at s = Tr. It is possible that other poles may be present. Recall that an absolutely 
integrable signal satisfies 


OD 
i. 


|x (t)| dt < ca 


a. Can x(t) be left sided? Explain. 

b. Can x(t) be right sided? Explain. 
c. Can x(t) be two sided? Explain. 
(t) 


d. Can x(t) be of finite duration? Explain. 


4.11.9 Using the definition, compute the bilateral Laplace transform, including the region of convergence (ROC), of the following complex- 
valued functions: 


a. x4(t) = (j + e)u(t) 
b. X(t) =j cosh (f)u(—1) 


Cc. 
xa(0) =e Pu(—t + 1) + jdt — 5) 


d. x4(t) = jfu(—t) + 8(t — Tr) 


4.11.10 A bounded-amplitude signal x(t) has bilateral Laplace transform X(s) given by 


X(s) = 


4.m.1 Express the polynomial C29(x) in standard form. That is, determine the coefficients a, of C29(x) = 5209 AX 


s2* 


(s — 1)(s + 1) 


a. Determine the corresponding region of convergence. 


b. Determine the time-domain signal x(t). 


20-k 


4.m.2 Design an order-12 Butterworth lowpass filter with a cutoff frequency of we. = 2115000 by completing the following. 


a. Locate and plot the filter 's poles and zeros in the complex plane. Plot the corresponding magnitude response |H|p(jw)| 


to verify proper design. 


. Setting all resistor values to 100,000, determine the capacitor values to implement the filter using a cascade of six 


secondorder Sallen-Key circuit sections. The form of a Sallen-Key stage is shown in Fig. P4.M-2. On a single plot, plot 
the magnitude response of each section as well as the overall magnitude response. Identify the poles that correspond to 
each section 's magnitude response curve. Are the capacitor values realistic? 


Figure P4.M-2: Sallen-Key filter stage. 


. Rather than a Butterworth filter, repeat Prob. P4.M-2 for a Chebyshev LPF with R = 3 dB of passband ripple. Since 


each Sallen-Key stage is constrained to have unity gain at dc, an overall gain error of 1/./1 + €? is acceptable. 


d. An analog lowpass filter with cutoff frequency Ww, can be transformed into a highpass filter with cutoff frequency We, by 


using an RCCR transformation rule: each resistor R; is replaced by a capacitor C '; = 1/RjW, and each capacitor C;’ = 
1/RjW> and each capacitor C; is replaced by a resistor Rj’ = 1/CjWe¢. 


Use this rule to design an order-8 Butterworth highpass filter with w. = 214000 by completing the following. 


a. Design an order-8 Butterworth lowpass filter with Ww. = 21714000 by using four second-order Sallen-Key 
circuit stages, the form of which is shown in Fig. P4.M-2. Give resistor and capacitor values for each stage. 
Choose the resistors so that the RC-CR transformation will result in 1 nF capacitors. At this point, are the 
component values realistic? 


b. Draw an RC-CR transformed Sallen-Key circuit stage. Determine the transfer function H(s) of the 
transformed stage in terms of the variables R’;, R’2, C’4, and C’o. 


c. Transform the LPF designed in part a by using an RC-CR transformation. Give the resistor and capacitor 
values for each stage. Are the component values realistic? 


Using H(s) derived in part b, plot the magnitude response of each section as well as the overall magnitude 
response. Does the overall response look like a highpass Butterworth filter? 


Plot the HPF system poles and zeros in the complex s plane. How do these locations compare with those 
of the Butterworth LPF? 


e. Repeat Prob. P4.M-4, using WwW, = 2111500 and an order-16 filter. That is, eight second-order stages need to be 
designed. 

f. Rather than a Butterworth filter, repeat Prob. P4.M-4 for a Chebyshev LPF with R = 3 dB of passband ripple. Since 
each transformed Sallen-Key stage is constrained to have unity gain at w = oo, an overall gain error of L/V¥1 + €* is 
acceptable. 


g. The MATLAB signal processing toolbox function butter helps design analog Butter-worth filters. Use MATLAB help to 
learn how butter works. For each of the following cases, design the filter, plot the filter's poles and zeros in the 
complex s plane, and plot the decibel magnitude response 20 log49 |H(jw)|. 


a. Design a sixth-order analog lowpass filter with we, = 27173500. 
b. Design a sixth-order analog highpass filter with Ww. = 21713500. 
c. Design a sixth-order analog bandpass filter with a passband between 2 and 4 kHz. 
d. Design a sixth-order analog bandstop filter with a stopband between 2 and 4 kHz. 


h. The MATLAB signal processing toolbox function cheby1 helps design analog Chebyshev type | filters. A Chebyshev 
type | filter has a passband ripple and a smooth stopband. Setting the passband ripple to Rp = 3 dB, repeat Prob. P4.M- 
7 using the cheby1 command. With all other parameters held constant, what is the general effect of reducing Rp, the 
allowable passband ripple? 


i. The MATLAB signal processing toolbox function cheby2 helps design analog Chebyshev type II filters. A Chebyshev 
type II filter has a smooth passband and ripple in the stopband. Setting the stopband ripple R, = 20 dB down, repeat 


Prob. P4.M-7 using the cheby2 command. With all other parameters held constant, what is the general effect of 
increasing Rg, the minimum stopband attenuation? 


j. The MATLAB signal processing toolbox function ellip helps design analog elliptic filters. An elliptic filter has ripple in 
both the passband and the stopband. Setting the passband ripple to Rp = 3 dB and the stopband ripple Rs = 20 dB 
down, repeat Prob. P4.M-7 using the ellip command. 


k. Using the definition Cp(x) = cosh(N cosh™'(x)), prove the recursive relation Cpj(x) = 2xCyy_4(x) — Cryy_2(X). 


|. Prove that the poles of a Chebyshev filter, which are located at p, = We sinh (&) sin (x) + jwe cosh(&) cos(,), lie on 


an ellipse. [Hint: The equation of an ellipse in the x—y plane is (x/a)2 + (ylb)? = 1, where constants a and b define the 
major and minor axes of the ellipse.] 


Chapter 5: Discrete-Time System Analysis Using the z-Transform 


OVERVIEW 


The counterpart of the Laplace transform for discrete-time systems is the z-transform. The Laplace transform converts integro- 
differential equations into algebraic equations. In the same way, the z-transforms changes difference equations into algebraic equations, 
thereby simplifying the analysis of discrete-time systems. The z-transform method of analysis of discrete-time systems parallels the 
Laplace transform method of analysis of continuous-time systems, with some minor differences. In fact, we shall see that the z- 
transform is the Laplace transform in disguise. 


The behavior of discrete-time systems is similar to that of continuous-time systems (with some differences). The frequency-domain 
analysis of discrete-time systems is based on the fact (proved in Section 3.8-3) that the response of a linear, time-invariant, discrete- 
time (LTID) system to an everlasting exponential z” is the same exponential (within a multiplicative constant) given by H [z]z”. We then 


express an input x [n] as a sum of (everlasting) exponentials of the form z”. The system response to x [n] is then found as a sum of 
the system's responses to all these exponential components. The tool that allows us to represent an arbitrary input x [n] as a sum of 


(everlasting) exponentials of the form z” is the z-transform. 


5.1 THE z-TRANSFORM 
We define X[z], the direct z-transform of x[n], as 


fos) 


X[z]= > x[n)e" (5.1) 


a=—oOo 


where z is a complex variable. The signal x [n], which is the inverse z-transform of X [z], can be obtained from X[z] by using the 
following inverse z-transformation: 


I 
2nj . 


x[n] = f X{ele ‘dz (5.2) 


The symbol ¢ indicates an integration in counterclockwise direction around a closed path in the complex plane (see Fig. 5.1). We derive 
this z-transform pair later, in Chapter 9, as an extension of the discrete-time Fourier transform pair. 


y'sn] 


Figure 5.1: y"u[n] and the region of convergence of its z-transform. 


As in the case of the Laplace transform, we need not worry about this integral at this point because inverse z-transforms of many 
signals of engineering interest can be found in a z-transform table. The direct and inverse z-transforms can be expressed symbolically 


X[zl=Z{xIn}} and x(n] = Z"{ Xz} 


or simply as 
x[n] —> XIz] 


Note that 
Z"(Zix[nl\l=xin] ands 227" {XI z]}] = XI zI 


LINEARITY OF THE z-TRANSFORM 
Like the Laplace transform, the z-transform is a linear operator. If 
xiln] — > Xi[z] and x.fn] — > XI z] 


then 


ayX,[n] + aaxy[n] <> a, Xi[z] + a2 X22] (5.3) 


The proof is trivial and follows from the definition of the z-transform. This result can be extended to finite sums. 


THE UNILATERAL z-TRANSFORM 

For the same reasons discussed in Chapter 4, we find it convenient to consider the unilateral z-transform. As seen for the Laplace 
case, the bilateral transform has some complications because of nonuniqueness of the inverse transform. In contrast, the unilateral 
transform has a unique inverse. This fact simplifies the analysis problem considerably, but at a price: the unilateral version can handle 
only causal signals and systems. Fortunately, most of the practical cases are causal. The more general bilateral z-transform is 
discussed later, in Section 5.9. In practice, the term z-transform generally means the unilateral z-transform. 


In a basic sense, there is no difference between the unilateral and the bilateral z-transform. The unilateral transform is the bilateral 
transform that deals with a subclass of signals starting at n = 0 (causal signals). Hence, the definition of the unilateral transform is the 
same as that of the bilateral [Eq. (5.1)], except that the limits of the sum are from 0 to oo 


X[z] = So xtn)e-" (5.4) 


n=O 


The expression for the inverse z-transform in Eq. (5.2) remains valid for the unilateral case also. 


THE REGION OF CONVERGENCE (ROC) OF X[z] 

The sum in Eq. (5.1) [or (5.4)] defining the direct z-transform X [z] may not converge (exist) for all values of z. The values of z (the 
region in the complex plane) for which the sum in Eq. (5.1) converges (or exists) is called the region of existence, or more commonly 
the region of convergence (ROC), for X[z]. This concept will become clear in the following example. 


EXAMPLE 5.1 
Find the z-transform and the corresponding ROC for the signal y”u[n]. 
By definition 
Xo 
X{z] =) "ula" 
n=0 
Since u[n] = 1 for all n => 0, 


X{z] = = (“) 


and os 


2 3 
n1+(Z)+ (2) +(2) et 83 


It is helpful to remember the following well-known geometric progression and its sum: 


, 3 I 
Lexx +x +e. = T= if |xj<1 (5.6) 


Use of Eq. (5.6) in Eq. (5.5) yields 


| 


Xz] 


=- Izl > lvl (5.7) 
oF. 
Observe that X [z] exists only for |z| > |y|. For |z| < |y|, the sum in Eq. (5.5) may not converge; it goes to infinity. Therefore, the ROC 
of X [z] is the shaded region outside the circle of radius |y|, centered at the origin, in the z-plane, as depicted in Fig. 5.1b. 


Later in Eq. (5.85), we show that the z-transform of another signal —y”u[—(n + 1)] is also z/(z — y). However, the ROC in this case is 
|z| < |y|. Clearly, the inverse z-transform of z/(z — y) is not unique. However, if we restrict the inverse transform to be causal, then the 


inverse transform is unique, namely, y"u [n]. 


The ROC is required for evaluating x [n] from X[z], according to Eq. (5.2). The integral in Eq. (5.2) is a contour integral, implying 
integration in a counterclockwise direction along a closed path centered at the origin and satisfying the condition |z| > |y|. Thus, any 
circular path centered at the origin and with a radius greater than |y| (Fig. 5.1b) will suffice. We can show that the integral in Eq. (5.2) 
along any such path (with a radius greater than |y|) yields the same result, namely x{n]. [1] Such integration in the complex plane 
requires a background in the theory of functions of complex variables. We can avoid this integration by compiling a table of z-transforms 
(Table 5.1), where z-transform pairs are tabulated for a variety of signals. To find the inverse z-transform of say, z/(z — y), instead of 


using the complex integration in Eq. (5.2), we consult the table and find the inverse z-transform of z/(z — y) as y"u[n]. Because of 
uniqueness property of the unilateral z-transform, there is only one inverse for each X[z]. Although the table given here is rather short, 
it comprises the functions of most practical interest. 


Table 5.1: (Unilateral) z-Transform Pairs 
= Open table as spreadsheet 


X{[n] X[zZ] 
delta[n—n] 


zk 
u[n] z 
z—1 
nu[n] ie 
(z —1)? 


No. 
7 
iz 
P| 
4 n2utn] 2(z + 1) 
(z-1) 
5 n8u[n] z(z* + 4z + 1) 
(z-1) 
8 | yfutn] 
7 ly uln—1] i 
z-y 
8 ny"u[n] ome 
z-¥ 
9 n?yPutnl y2z+y) 
(z—y) 
10 n(n — 1)(n —2)---(n—m+ 1) z 


y™m! yeuln] (z—y)"*! 


11a |! |y"| cosBn ufn] ae - 
z? — (2|ly| cos B)z + ly 


ly|"sinBn u[n] zly|sin B 
z? — (2|y| cos B)z + ly? 


rlyI? cos(Bn+ 8)ufn] izes = Wwiskte 2 
z? — (2|y| cos B)z + ly |? 


rly” cos(yn+ @)u[n] y=lylel¥ (0.5re/”)z Ft (0.5re~/”)z 
z-y z-y* 


rly|"cos(yn+8)u[n] z(Az + B) 
z? 4+ 2az+ly/? 


The situation of the z-transform regarding the uniqueness of the inverse transform is parallel to that of the Laplace transform. For the 
bilateral case, the inverse z-transform is not unique unless the ROC is specified. For the unilateral case, the inverse transform is 


unique; the region of convergence need not be specified to determine the inverse z-transform. For this reason, we shall ignore the ROC 
in the unilateral z-transform Table 5.1. 


EXISTENCE OF THE z-TRANSFORM 


By definition 
os oO 


x[n] 
-i— a 
Xi =) xia = 
n=O a= ~* 

The existence of the z-transform is guaranteed if 

oO 

[x[7]] 

IXIzll < 5) ——— < 

— ie 


for some |z|. Any signal x[n] that grows no faster than an exponential signal rg, for some ro, satisfies this condition. Thus, if 


|x[n]| < r2 for some ro (5.8) 
then 
=f % \" I 
|X[z]| <> (4) arm lz| > ro 
n=O by — 


Iz| 
Therefore, X[z] exists for |z| > ro. Almost all practical signals satisfy condition (5.8) and are therefore z-transformable. Some signal 
models (e.g., y") grow faster than the exponential signal r”g (for any rg) and do not satisfy Eq. (5.8) and therefore are not z- 


transformable. Fortunately, such signals are of little practical or theoretical interest. Even such signals over a finite interval are z- 
transformable. 


EXAMPLE 5.2 


Find the z-transforms of _ 


a. 8[n] 
b. u[n] 
c. cos Bn u[n] 


d. The signal shown in Fig. 5.2 


x[n] 


Figure 5.2 


Recall that by definition 


X{2] = So xtae" 


a 2] x13 
= Ho) 4 22), 22), 20). 69) 
a. For x[n] = 8[n], x[0] = 1 and x[2] = x[3] = x[4] = ... = 0. Therefore 
5[n] => 1 for all z (5.10) 


S 


For x[n] = u[n], x[0] = x[1] = x[3] = ... = 1. Therefore 


L.4 l 
ieee ta 


From Eq. (5.6) it follows that 


1 1 
X{[z] cas 1 ms <1 
* 
= Iz] >1 
Therefore 
unl —— > I (5.11) 


c. Recall that cos Bn = (e/8” + e/B")/2. Moreover, according to Eq. (5.7), 


+jpn = me + jp) 
e*/P" yin] <> aT lz] > jer” |=1 
Therefore 


» af 7 
~ ~ 


l = 
X[z] = 2 ee olB i -=-e 55 


_ __ 2(z—cos B) Iz] > 1 
~ g2—2zcos B +1 * 
d. Here x[0] = x[1] = x[2] = x[3] = x[4] = 1 and x[5] = x[6] = ... = 0. Therefore, according to Eq. (5.9) 
X[z] = 


Mora tata 


oe ae 
e+e +e tet! 
aa for all z #0 


< 


We can also express this result in a more compact form by summing the geometric progression on the right-hand side of 
the foregoing equation. From the result in Section B.7-4 with r = 1/z, m= 0, and n = 4, we obtain 


(:)-G) 
X[z = VOY = a - 2) 


EXERCISE E5.1 


1. Find the z-transform of a signal shown in Fig. 5.3. 


x[n] 


0 2 ee eS Pree 


Figure 5.3 


2. Use pair 12a (Table 5.1) to find the z-transform of x[n] = 20.65(./2)" cos ((11/4)n — 1.415)u[n]. 


Answers 


1 Pte ete tz74+7+41 z 
Xi) = oe 4_ 2-10 
Zz z-1 
2. 


~ 


z(3.2z + 17.2) 
z*—2z+2 


5.1-1 Finding the Inverse Transform 


As in the Laplace transform, we shall avoid the integration in the complex plane required to find the inverse z-transform [Eq. (5.2)] by 
using the (unilateral) transform table (Table 5.1). Many of the transforms X[z] of practical interest are rational functions (ratio of 
polynomials in z), which can be expressed as a sum of partial fractions, whose inverse transforms can be readily found in a table of 
transform. The partial fraction method works because for every transformable x[n] defined for n => 0, there is a corresponding unique 
X[z] defined for |z| > ro (where rp is some constant), and vice versa. 


EXAMPLE 5.3 


Find the inverse z-transform of 
8z—19 
a. (< —2)(z —3) 


b. (z—1)(z-—2)? 
22z(3z + 17) 
c. (2 — 1)(z? — 6z + 25) 
a. Expanding X{z] into partial fractions yields 


XI[z OO —— 
[z] (z —2)(z —3) r=) "723 


From Table 5.1, pair 7, we obtain 


x[n] = [3(2)""'! +5@G)"""Juln — 1] (5.12a) 


If we expand rational X[z] into partial fractions directly, we shall always obtain an answer that is multiplied by u[n — 1] 
because of the nature of pair 7 in Table 5.1. This form is rather awkward as well as inconvenient. We prefer the form that 
contains u[n] rather than u[n — 1]. A glance at Table 5.1 shows that the z-transform of every signal that is multiplied by 
u[n] has a factor z in the numerator. This observation suggests that we expand X[z] into modified partial fractions, where 
each term has a factor z in the numerator. This goal can be accomplished by expanding X[z]/z into partial fractions and 
then multiplying both > by z. We shall demonstrate this procedure by reworking part (a). For this case 


z] 8z— 


z -x(z— 2)(z —3) 
(—19/6) | (3/2) , (5/3) 
—— —— a —— 
Z cs i—2 * 7=3 
Multiplying both sides by z yields 
C 7 


mend (oy) § (SS) 


6 2\z-2 3\z-3 


From pairs 1 and 6 in Table 5.1, it follows that 


x[n} = —2d[n} + [$(2)" + $(3)"] ala) (5.12b) 


The reader can verify that this answer is equivalent to that in Eq. (5.12a) by computing x[n] in both cases for n = 0, 1, 2, 
3, ..., and comparing the results. The form in Eq. (5.12b) is more convenient than that in Eq. (5.12a). For this reason, we 
shall always expand X[z]/z rather than X[z] into partial fractions and then multiply both sides by z to obtain modified partial 
fractions of X[z], which have a factor z in the numerator. 
xi] z(2z” — 11z + 12) 

b. (z—1)(z —2)3 


and 


X{z]  2z7-11z+ 12 


z  (z—1)(z—2) 


where 


227 —11z+12 
ew (< -2)7|_ 
2z7 —11z+ 12 


(z — 1), 


Therefore 


a = 


X(z] 22? —11z+12 3 2 a ay 
LOE et 5.2L ae (5.13) 
z (z-1)2-2P z-1 (2-2) (z-2) (2-2) 


We can determine a, and a2 by clearing fractions. Or we may use a shortcut. For example, to determine a2, we multiply 
both sides of Eq. (5.13) by z and let z — oo. This yields 
0=-3-04+04+@ => m=3 


This result leaves only one unknown, a4, which is readily determined by letting z take any convenient value, say z = 0, on 
both sides of Eq. (5.13). This step yields 
2 


Ps ay 3 

a tata 2 

which yields a, = —1. Therefore 

Xiz]_ 3 = =6p2d 3 

2 z-l @-2 @- 2-2 
and : 7 s 
ela el a a 


Now the use of Table 5.1, pairs 6 and 10, yields 
AAD By i 
x[a] = |—3 2 — 2)" — 52)" + 3(2)"| ula] 


=— 3 + 0 +n— 12,2" u[n] 


. Complex ue GB 17 
22(5Z + Li) 
X{z] = —_—————— 
ul (z — 1)(z? — 6z + 25) 
_ 2z(3z + 17) 
(¢—I)e—3— J9E—-3 + I4 


Poles of X[z] are 1,3 + j4, and 3 — j4. Whenever there are complex conjugate poles, the problem can be worked out in 
two ways. In the first method we expand X{[z] into (modified) first-order partial fractions. In the second method, rather than 
obtain one factor corresponding to each complex conjugate pole, we obtain quadratic factors corresponding to each pair of 
complex conjugate poles. This procedure is explained next. 


METHOD OF FIRST-ORDER FACTORS 
X[z] _ 2(3z + 17) i. 2(3z + 17) 
z (z= 1? —62 +25) (2 — D(z —3 — f4)(z —3 + J) 
We find the partial fraction of X[z]/z using the Heaviside "cover-up" method: 


Xiz]_ 2, L626 1G e/26 


-— —— 
Zz z-1 F5— Jk 


and 


X[z] =2 : “ 


1.6e" 2) —_—__. + (1.6/7) —_—_ 
=i" 73-4" 7-344 
The inverse transform of the first term on the right-hand side is 2u[n]. The inverse transform of the remaining two terms 
(complex conjugate poles) can be obtained from pair 12b (Table 5.1) by identifying r/2 = 1.6, 8 = —2.246 rad, y =3 + j4 = 
5@/0-927 so that |y| = 5, B = 0.927. Therefore 
x[n] = [2 + 3.2(5)" cos (0.927n — 2.246) ]u[n] 


METHOD OF QUADRATIC FACTORS 

X[z] _ 2(3z + 17) _ 2 ‘ Az+B 

z (z—1)(z?-—62 +25) z—-1 z2*-6z4+25 
Multiplying both sides by z and letting z — ©, we find 
0=2+A=—>A=-2 


and 


2(3z + 17) _ 2 4 —27+B 
(z—1)(22-—6z+25) z—-1 z—62+25 


To find B, we let z take any convenient value, say z = 0. This step yields 


= 2+ 5 B= 16 
Therefore 

X[z]_ 2 —2z +16 
“fe Gal Seas 
a 2 —2 16 
XI) = — + St 


2—1 °° #=—624+25 
We now use pair 12c, where we identify A = —2, B = 16, |y| = 5, and a = —3. Therefore 


v use pair 12c, whe 
100 + 256 — 192 3 
PRED ja lE an a (3) =0.927 ra 


25-9 5 
and 
@ = tan"! (=2) = —2.246 rad 
so that 


x[n] = [2 + 3.2(5)" cos (0.927n — 2.246) ]u[n] 


EXERCISE E5.2 
Find the inverse z-transform of the following functions: 


1. z(2z — 1) ? 
(z — 1)(z + 0.5) 

2. 1 ? 
(z — 1)(z + 0.5) 

3. 9 Se 
(z+2)(z — 0.5)? 

4. 5z(z—1) 
z?— 1.6z+ 0.8 


[Hint: /0.8 = 2/,/5.] 
Answers 
1. [2 + $(—-0.5)"]uln] 
2. —28[n] + [2 + $(-0.5)"]uln] 


3. 188[n] — [0.72(—2)" + 17.28(0.5)" — 14.4n(0.5)"Ju[n] 
4. 


553 ()" cos (0.464n + 0.464)u [a] 


INVERSE TRANSFORM BY EXPANSION OF X[z] INPOWER SERIES OF z™! 


By definition 
fo <] 


X[z] x x[ajz" 


a= 


x[O]z° + x[1]z7! + x[2]z7? + x[3]z> +--- 


This result is a power series in z~'. Therefore, if we can expand X{z] into the power series in z |, the coefficients of this power series 
can be identified as x[0], x[1], x[2], x[3],.... A rational X[z] can be expanded into a power series of Zz! by dividing its numerator by the 
denominator. Consider, for example, 
XIz] z?(7z — 2) 
“ (z—0.2)(z — 0.5)(z — 1) 
723 — 22? 


z3 — 1.7z?7 + 0.8z —0.1 
To obtain a series expansion in powers of z~', we divide the numerator by the denominator as follows: 


7 +9.927' + 11.2327? + 11.8723 
2 — 1.72? + 0.82 —0.1)7z? — 2z? 
7z3 — 11.922 + 5.60z— 0.7 
9.9z*— 5.60z+ 0.7 
9.9z? — 16.83z + 7.92 — 0.99z-! 
11.23z— 7.22+0.99z7! 
11.23z — 19.09 + 8.98z~! 


x[0] + 


11.87 —7.99z 
Thus 
Xf2) = ee =). 9.9271 4 11.280? + 872 + 
“~ (2 = 0.22 -0.52— 1) = — =e 
Therefore 


x[0] = 7, x[{1] = 9.9, x{2] = 11.23, x[3] = 11.87,... 


Although this procedure yields x[n] directly, it does not provide a closed-form solution. For this reason, it is not very useful unless we 
want to know only the first few terms of the sequence x[n]. 


EXERCISE E5.3 


Using long division to find the power series in z, show that the inverse z-transform of z/(z — 0.5) is (0.5)” u[n] or (2)-" u[n]. 


RELATIONSHIP BETWEEN h[n] AND H[z] 
For an LTID system, if A[n] is its unit impulse response, then from Eq. (3.71b), where we defined H[z], the system transfer function, we 
write 


“x 


H[z] = > h{ajz" (5.14a) 


a=—co 


For causal systems, the limits on the sum are from n = 0 to o. This equation shows that the transfer function H[z] is the z-transform of 
the impulse response h[n] of an LTID system; that is, 


h{n] —> H[z] (5.14b) 


This important result relates the time-domain specification h[n] of a system to H[z], the frequency-domain specification of a system. 
The result is parallel to that for LTIC systems. 


EXERCISE E5.4 


Redo Exercise E3.14 by taking the inverse z-transform of H[z], as given by Eq. (3.73). 


[tlindeed, the path need not even be circular. It can have any odd shape, as long as it encloses the pole(s) of X[z] and the path of 
integration is counterclockwise. 


5.2 SOME PROPERTIES OF THE z-TRANSFORM 


The z-transform properties are useful in the derivation of z-transforms of many functions and also in the solution of linear difference 
equations with constant coefficients. Here we consider a few important properties of the z-transform. 


In our discussion, the variable n appearing in signals, such as x[n] and y[n], may or may not stand for time. However, in most 
applications of our interest, n is proportional to time. For this reason, we shall loosely refer to the variable n as time. 


In the following discussion of the shift property, we deal with shifted signals x[n]u[n], x[n — k]u[n — k], x[n — kju[n], and x[n + kju[n]. 
Unless we physically understand the meaning of such shifts, our understanding of the shift property remains mechanical rather than 
intuitive or heuristic. For this reason using a hypothetical signal x[n], we have illustrated various shifted signals for k = 1 in Fig. 5.4. 


x[n] 
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Figure 5.4: A signal x[n] and its shifted versions. 


RIGHT SHIFT (DELAY) 


If 
x[n]u[n] — > X[z] 
then 
x[n — Yufn —- 1] <— *xt2) (5. 15a) 
In general, 


x[n — mju[n — m] = + xt) (5.15b) 


Moreover, 


l 
x[a — u[n] > -X[z] + x1-1) (5.16a) 
Repeated application of this property yields 


x[a — 2Ju[n] — [=xta + x1) + x[-—2] 


= + xt + ey +x[-2] (5.16b) 


In general, for integer value of m 


nm 
x[n — mju[n] — > 2" X[z] +2" >> x[-n]e" (5.16¢) 


aal 


A look at Eqs. (5.15a) and (5.16a) shows that they are identical except for the extra term x[—1] in Eq. (5.16a). We see from Fig. 5.4c 
and 5.4d that x[n — 1]u[n] is the same as x[n — 1]u[n — 1] plus x[—1]8[n]. Hence, the difference between their transforms is x[— 1]. 


Proof. For integer value of m 


Z{x[n — mju[n — m]} = So xin — m]u[n —m]z" 


n=O 


Recall that x[n — m]ju[n — m] = 0 for n < m, so that the limits on the summation on the right-hand side can be taken from n = m to oo. 
Therefore 


Z{x[n — mju[n — m]} = So xin — mz" 


a3 
_ > x[rjze-"*™ 


r= 


1 = ” — 
ww 2k = = A[z] 
r=0 sa 


To prove Eq. (5.16c), we have 
w ~ 


Z{x[n — m]u{n]} = So xin ~m)z" = bd x[rygceo 
n=0 r=—m 
1 oo 
mo | 3 xe + abe 
s=—m r=0 
=7" > x[-a]z" sae xz" X{[z] 
n=1 
LEFT SHIFT (ADVANCE) 
If 
x[nju[n] ——> Xz] 
then 
x[n + lun] — > zX[z] — zx[0] (5.17a) 


Repeated application of this property yields 
x[n + 2Ju[n] —— z{z(X[z] — zx[0]) — x[1)) 
= 2°X{[z] — z*x{0] — 2x11] (5.17b) 


and for integer value of m 


m—1 
x[n + mula] <=> 2"X{[z]— 2" 5° xine" (5.17¢) 


anf 


Proof. By definition 


Zxin + mJuln}} = S> xfa + mz 
n=O 


oo 


= te 
rm 


= 2") xir)z” 


oo m—1 
= | oat - atric” 
r=0 r=0 


m—1 
= 2"X[z]— 2") xine 
r=0 


EXAMPLE 5.4 


Find the z-transform of the signal x[n] depicted in Fig. 5.5. 


x[n] 


Figure 5.5 


The signal x[n] can be expressed as a product of n and a gate pulse u[n] - u[n — 6]. Therefore 
x[n] = n{u[n] — u[n — 6]} 
= nu[n] — nu[n — 6] 


We cannot find the z-transform of nu[n — 6] directly by using the right-shift property [Eq. (5.15b)]. So we rearrange it in terms of (n — 
6)u[n — 6] as follows: 
x[n] = nu[n] — (n —6 + 6)u[n — 6] 
= nu[n] — (n — 6)u[n — 6] — 6u[n — 6] 
We can now find the z-transform of the bracketed term by using the right-shift property [Eq. (5.15b)]. Because u[n] <=> z/(z — 1) 
n~qe3 Ss 
un — = FF 
Sz—-1 re=) 


Also, because nu[n] = z/(z — 1)? 


; 1 
(n — 6)u[n — 6] => 2(z—-1p 2(z—1) 


Therefore 


EXERCISE E5.5 


Using only the fact that u[n] <=» z/(z — 1) and the right-shift property [Eq. (5.15)], find the z-transforms of «) 
the signals in Figs. 5.2 and 5.3. - 


Answers 


See Example 5.2d and Exercise E5.1a. 


CONVOLUTION 
The time-convolution property states that if{t] 
Xin] => Xilz] and on] > X2[zI, 


then (time convolution) 


xi [n] * x2[n] <> Xi[z]X2Iz] (5.18) 


Proof. This property applies to causal as well as noncausal sequences. We shall prove it for the more general case of noncausal 
sequences, where the convolution sum ranges from — co to oo. 


We have 


oo 


Z x, Xi[/m|x2|n — m] 


Z{xi[n] * x2ln]} 


R= —OO 
©. ~ 
= >» g* >, x [mn )}x2[2 — m] 
Aa=-—-oO m—-—2o 


Interchanging the order of summation, we have 
) oo 


x 


Z[y\ [a] * x2[n]] = » xi [m] ». x2[n — m]z" 
ae: ~ 
= 0 alm) SO xtrieo™ 
= 0 mbale SO xlrie” 
= X,[z1Xalzl 


LTID SYSTEM RESPONSE 


It is interesting to apply the time-convolution property to the LTID input-output equation y[n] = x[n] * h[n]. Since from Eq. (5.14b), we 
know that h[n] <=> H[z], it follows from Eq. (5.18) that 


Y[z] = X[z]A[z] (5.19) 


EXERCISE E5.6 
Use the time-convolution property and appropriate pairs in Table 5.1 to show that u[n] * u[n — 1] = nun]. 


MULTIPLICATION BY y” (SCALING IN THE z-DOMAIN) 


If 
x[nju[n] — > X[z] 


then 


y"x[nJu[n] <> X = (5.20) 


Proof. 


a=0 
“eng =*/ 5 
n=) Y Y 


EXERCISE E5.7 


Use Eq. (5.20) to derive pairs 6 and 8 in Table 5.1 from pairs 2 and 3, respectively. 
MULTIPLICATION BY n 


If 
x[nju[n] — > XTz] 


then 
d 

nx[nju[n] — ~257 Xz] (5.21) 
Proof. 

d 
—z—X ee | 

qk = -23, 2+) 

=-Z > —nx{njz" 
n=0 


So nx[aje = Z{nx|nJu[na}} 


n=O 


EXERCISE E5.8 
Use Eq. (5.21) to derive pairs 3 and 4 in Table 5.1 from pair 2. Similarly, derive pairs 8 and 9 from pair 6. 


TIME REVERSAL 


If 
x[n] => XIz] 


then!t] 

x[—n] = > XT1/z] (5.22) 
Proof. = 
Z{x[-a}} = 0 xt-ale 


Aa=-—o 
Changing the sign of the dummy variable n yields 
fos 
Z{x[-n}} = S> xine” 
n=—00 


ox 


>> xinid/z)" 


a=—0o 


= X[1/z] 


The region of convergence is also inverted, that is, if ROC of x[n] is |z| > |y|, then, the ROC of x[—n] is |z| < 1/ly|. 


EXERCISE E5.9 
Use the time-reversal property and pair 2 in Table 5.1 to show that u[—n] <= —1/(z — 1) with the ROC |z| < 1. 


INITIAL AND FINAL VALUES 


For a causal x[n], 


x[0] = jim. X[z] 


(5.23a) 


This result follows immediately from Eq. (5.9). 


We can also show that if (z — 1) X (z) has no poles outside the unit circle, then!T] 


Jim, x{N] = lim(z — Xz) 


(5.23b) 


All these properties of the z-transform are listed in Table 5.2. 


Table 5.2: z-Transform Operations 
= Open table as spreadsheet 


Operation x[n] 


X[z] 


Addition x4[n] + x2[n] 


X1[Z] + XalZ] 


[Scalar multiplication | [Scalar multiplication | ax[n] 


| shifting X[n — mJu[n — m] 


aaa i — mlfu[n] 1 


~ teal 


n=l 


a ae — 3Ju[n] 


Left- — x[n + hell 


1 ytg] + x[-1] 

Zz 

1 1 

> XIz] + ~x[—1] +x[-—2] 


1 l 1 
lz) Bw ail-i + +x[—2] + x[—3] 


2"X{[z]— 2") x{n)z™ 


n=) 


[tn + tut + 7Ju[n] 


[xin + tutn] zm xpey — zx[0] 


——— 


[tn + utr + 2ju[n] 


|_| by y” canna x[nJu[n] 


z™X[z] — zx[0] — zx[1] 


z™X[z] — zx[0] — zx[1] —zx[2] 


| by n nx[nju[n] 


fase — 


‘ae value ae 


d 
—7 Xt] 


X4[Z] X2[Z] 
X[1/z] 


lim X{[z] 


~_—_ value Jim x Pg — 


him(z — 1)X[z] 


poles of 


(z — 1)X[z] inside the unit circle 


[tlThere is also the frequency-convolution property, which states that if 


nina e—". $ Xu) X2 [=| un'du 
aaj u 


[tlFor complex signal x[n], the time-reversal property is modified as follows: 
x*[—n] <=> X'*[1/z"] 


[tlThis can be shown from the fact that 


x[n] —x[n — 1] <— {1 - +} xizi= Ae 1)AUa) 


~ 


and 
(z- _ z 
(z= 1)Xlz} = So binl- x 1J}z" 
and 
y 
lim 2 = lim(z — 1)X[z) = lim Jim 2 {x[n] —a[n —1]jz" = im x[N] 


ano 


5.3 Z-TRANSFORM SOLUTION OF LINEAR DIFFERENCE EQUATIONS 


The time-shifting (left-shift or right-shift) property has set the stage for solving linear difference equations with constant coefficients. As 
in the case of the Laplace transform with differential equations, the z-transform converts difference equations into algebraic equations 
that are readily solved to find the solution in the z domain. Taking the inverse z-transform of the z-domain solution yields the desired 
time-domain-solution. The following examples demonstrate the procedure. 


EXAMPLE 5.5 
Solve 


y[n + 2] — Sy[n + 1] + 6y[n] = 3x[n + 1) + S5x[n] (5.24) 


if the initial conditions are y[—1] = 11/6, y[—2] = 37/36, and the input x[n] = (2)"" u[n]. 


As we shall see, difference equations can be solved by using the right-shift or the left-shift property. Because the difference equation, 
Eq. (5.24), is in advance operator form, the use of the left-shift property in Eqs. (5.17a) and (5.17b) may seem appropriate for its 
solution. Unfortunately, as seen from Eqs. (5.17a) and (5.17b), these properties require a knowledge of auxiliary conditions y[0], y[1]...., 
y[N — 1] rather than of the initial conditions y[-1], y[-2],..., yi—n], which are generally given. This difficulty can be overcome by 
expressing the difference equation (5.24) in delay operator form (obtained by replacing n with n — 2) and then using the right-shift 


property. [T] Equation (5.24) in delay operator form is 
y[n] — 5y[n — 1] + 6y[n — 2] = 3x[n — 1] + 5x[n — 2] (5.25) 


We now use the right-shift property to take the z-transform of this equation. But before proceeding, we must be clear about the meaning 
of a term like y[n — 1] here. Does it mean y[n — 1]u[n — 1] or y[n — 1]u[n]? In any equation, we must have some time reference n = 0, 
and every term is referenced from this instant. Hence, y[n — k] means y[n — k]u[n]. Remember also that although we are considering 
the situation for n = 0, y[n] is present even before n = 0 (in the form of initial conditions). Now 

yinju[n] — os 


y{n — 1Ju[n] —= - =¥{c J+3{-U= “Ykz ]+ = 


11 ra 
yn — uta] —> S¥K2 ]+ ~yf-11+ yl- -2)= Yk: is +3 
Noting that for causal input x[n], 

x[—1] = x[-—2] =--- = x[-—n]=0 
We obtain 
x[n] = (2) “ufn) = (2°')"ufn] = (0.5)"u[n] —> - = = 
=J yd 44-1) + —* 46 = —... 
x[n dela} emt (z) + 21 eo Cd oe 
I] | 1 1 
x[a —2Ju[n]) == =X) + ~x[~1) +x[-—2] = = XI<) +0+0= 205) 


In general 


x[n — rju[n] —— + x{z 


Taking the z-transform of Eq. (5.25) and substituting the foregoing results, we obtain 


viei-s|+ rel+ +6[5ul+ 2 +37 maa = 
or 
(1 —=4 ) Iz} - : = i. -—~- <r (5.26b) 
from which we obtain 
— 9.5z + 10.5) 
)¥[z] = “ —95) 
so that 
z(3z? — 9.5z + 10.5) 
Y{z] = —————_—_- §:27 
[2] (z — 0.5)(z? — 5z + 6) ued 
and 
¥[z 327 -9.5z+ 10.5 


z z — 0.5)(z — 2)(z — 3) 


_ (26/15) _ (7/3) Z (18/5) 
oe ae ee 


Therefore 
26 Zz 7 Zz 18 Zz 
Mal = 75 (5) =) (5) +3(=5) 
and 
yin} = [2(0.5)" — 2(2)" + 83)"Jutn) (5.28) 


This example demonstrates the ease with which linear difference equations with constant coefficients can be solved by z-transform. 
This method is general; it can be used to solve a single difference equation or a set of simultaneous difference equations of any order 
as long as the equations are linear with constant coefficients. 


Comment. Sometimes, instead of initial conditions y[- 1], y[-2],..., yi—n], auxiliary conditions y[0], y[1],..., y[N — 1] are given to solve a 
difference equation. In this case, the equation can be solved by expressing it in the advance operator form and then using the left-shift 
property (see later: Exercise E5.11). 


EXERCISE E5.10 


Solve the following equation if the initial conditions y[—1] = 2, y[—2] = 0, and the input x[n] = u[n]: <— 
y[n + 2] — Zyin + 1] + dy[n) = Sxin + 1] — xIn] : 


Answers 


ya] = [12 — 15(4)" + 2(3)"] ala] 


EXERCISE E5.11 


Solve the following equation if the auxiliary conditions are y[0O] = 1, y[1] = 2, and the input x[n] = u[n]: 9 
y[n] + 3y[n — 1) + 2y[n — 2) = x[n — 1] + 3x[n — 2] - 


Answers 


yin) = [3 + 2(-1)" — $(-2)"] ula] 


ZERO-INPUT AND ZERO-STATE COMPONENTS 


In Example 5.5 we found the total solution of the difference equation. It is relatively easy to separate the solution into zero-input and 
zero-state components. All we have to do is to separate the response into terms arising from the input and terms arising from initial 
conditions. We can separate the response in Eq. (5.26b) as follows: 


5 6 11 3 5 
(1 Bu 5) "lel - (3 ~ =) “7-05 ' 22-05) om) 
—— —<—<—$——_ 
initial condition terms terms arising from inpet 
Therefore 
5 6 ) 11 (3z +5) 
1-—--+-—) ¥[z]= 3-— +-—-—— 
( :* = z z(z — 0.5) 
—$ — 
initial condition terms input terms 
Multiplying both sides by z? yields 
, 2(3z +5) 
(2? -—5z2+6)¥[z]= 23z-11) +——— 
oe Zz =— 0.5 
initial condition terms =$“———~——— 
input terms 
and 
2(3z—11 z(3z+5) 
Y[z] = (32 ) 2(3z + 5) (5.30) 


z2—5z+6 (z—0.5)(z? —5z +6) 
zero-inpul response zero-siale response 


We expand both terms on the right-hand side into modified partial fractions to yield 


and 
y[n] = | 5(2)" — 2(3)" — 2(2)" + 403)" + 28(0.5)"| un] 
_——_—_ i, 


zero input Zero state 
= [-3(2)" + $3)" + 30.5)"] ula] 
which agrees with the result in Eq. (5.28). 


EXERCISE E5.12 


Solve 9 
yla +2] — Zy[n + 1) + Lyla] = Sxin + 1] — x[a] : 


if the initial conditions are y[—1] = 2, y[—2] = 0, and the input x[n] = u[n]. Separate the response into zero- 
input and zero-state components. 


Answers 


y[n] = (ea — $(4)"] + [12 — 18(4)" + 6(4)"] Jn 
a 


zero input zero state 


= (12 —15(4)" + 8(4)"] at) 


5.3-1 Zero-State Response of LTID Systems: The Transfer Function 


Consider an Nth-order LTID system specified by the difference equation 


O[E]y[n] = P[E]x[n] (5.3 1a) 
or 
(EX +a, E*-' +--+ + ay_)E + ay)yla] 
= (EN +b, EX | +---+by iE + bw)axlal (5.31b) 
or 


y[n + N] + auy[n + N — 1] +--+ ay .y[n + 1] + ayyln] 
= box[n + N]+--- + byixta + 1] 4+ byxi[n] (5.31c) 


We now derive the general expression for the zero-state response: that is, the system response to input x[n] when all the initial 
conditions y[-1] = y[-2] = ... = y[—N] = 0 (zero state). The input x[n] is assumed to be causal so that x[—1] = x[-2] = ... = x[—N] = 0. 


Equation (5.31c) can be expressed in the delay operator form as 
y[n] + a,y[n — 1] +--+: +ayy[n — NJ 
= box[n] + bix[a — 1] +--+: +byxin — NI (5.31d) 
Because y[—r] = x[—r] = 0 for r=1, 2, ..., N 


y[n — m|u{n] —> —Y¥[z] 


1 
x[a — mula] = *lzI mw i1,2,...,N 


Now the z-transform of Eq. (5.31d) is given by 


ay ay ayn by 
(144 S443) rter= (m4 4 


> 
ze 
< 


by 
be SE) xt 


Multiplication of both sides by z" yields 
(oY +ayze! +--+ + ayiz + ay) ¥IzI 


= (boz® +b zN) +--+ + by_iz + bw) XIzI 


Therefore 
boz® + b,z*-! ae + by iz +n 
SS ee 5.32 
ul eee [z] (5.32) 
Piz] 
= ora (5.33) 
lz] 


We have shown in Eq. (5.19) that Y[z] = X[z]H[z]. Hence, it follows that 


Plz] boz® + byz'—! +--+ + by iz + by 
iia. 2 2 ee (5.34) 
lz) 2Y az’! +++ + Gni1Z + ay 
As in the case of LTIC systems, this result leads to an alternative definition of the LTID system transfer function as the ratio of Y[z] to 
X[z] (assuming all initial conditions zero). 


Y[z Z[zero-state response 

X[z] Z{input) 
ALTERNATE INTERPRETATION OF THE z-TRANSFORM 
So far we have treated the z-transform as a machine, which converts linear difference equations into algebraic equations. There is no 
physical understanding of how this is accomplished or what it means. We now discuss more intuitive interpretation and meaning of the 
z-transform. 


In Chapter 3, Eq. (3.71a), we showed that LTID system response to an everlasting exponential z” is H[z]z". If we could express every 


discrete-time signal as a linear combination of everlasting exponentials of the form z”, we could readily obtain the system response to 
any input. For example, if 


K 
xin] = >> X[zelzf (5.36a) 


t=1 


the response of an LTID system to this input is given by 


K 
yin) = 5 Xz) Alzeley (5.36b) 
— 


Unfortunately, a very small class of signals can be expressed in the form of Eq. (5.36a). However, we can express almost all signals of 
practical utility as a sum of everlasting exponentials over a continuum of values of z. This is precisely what the z-transform in Eq. (5.2) 
does. 


1 
x[a] = aaj f Mek” ‘dz (5.37) 
2x j 
de] Pera Mal ms Ye] = MMe) Xe] op Maj 
Expresses ala] System response to The eum of all exponential 


as a sum of an exponential component responses results 


everlasting exposertials Mele" ie Mle} X tebe" in the carpet yfn) 


fa) 


XI ma Viz) © Ml Xtz) 


ib) 


Figure 5.6: The transformed representation of an LTID system. 


Invoking the linearity property of the z-transform, we can find the system response y[n] to input x[n] in the Eq. (5.37) ast] 


| 
vIn] = = f X[z]H[zle"! dz = 27 (X[x]H Id} 


Clearly 


Y[z] = X[z]HIzl 


This viewpoint of finding the response of LTID system is illustrated in Fig. 5.6a. Just as in continuous-time systems, we can model 
discrete-time systems in the transformed manner by representing all signals by their z-transforms and all system components (or 
elements) by their transfer functions, as shown in Fig. 5.6b. 


The result Y[z]=H[z]X[z] greatly facilitates derivation of the system response to a given input. We shall demonstrate this assertion by an 
example. 


EXAMPLE 5.6 
Find the response y[n] of an LTID system described by the difference equation 


y[n + 2] + y[n + 1] + 0.16y[n] = x[n + 1] + 0.32x[n] 


Oo 


: 
(E> + E +0.16)y[n] = (£ + 0.32)x[n] 


for the input x [n]=(—2)~” u[n] and with all the initial conditions zero (system in the zero state). 


From the difference equation we find 


P{z] z+0.32 
i 5 le 
Qlz] 27+2+0.16 
For the input x[n]=(—2)"" u[n]=[(—2)7"]"u(n)=(—0.5)" un] 


X[z a 
[z] z+0.5 


and 


z(z + 0.32) 
Y[zl = X[zlH[<] = = 


(z2+2z+0.16)(z + 0.5) 


Therefore 


Y[z] (z + 0.32) (z + 0.32) 

~ (4240162 +0.5) (2 +0.2Nz + 0.82 +0.5) 
2/3 8/3 2 

z+02 24+08 z2+05 


(5.38) 


2 Zz 8 z z 
Y[z] == -=(———}+2 39 
lz] = (—5s) = (=53)+ (=) 5) 


and 
y[n] = [2(—0.2)" — $(—0.8)" + 2(—0.5)"] u[n] 


EXAMPLE 5.7: (The Transfer Function of a Unit Delay) 


Show that the transfer function of a unit delay is 1/z. 


If the input to the unit delay is x[n]u[n], then its output (Fig. 5.7) is given by 
y[n] = x[n — lJu[n — 1] 


a[n]u[n] x[n — 1Ju[n — 1] 
TS EEE ee =. 
XtzI Vil = Xt) 
Figure 5.7: Ideal unit delay and its transfer function. 


al 


The z-transform of this equation yields [see Eq. (5.15a)] 
I 
Y[z] = -X{z] 
= A[z)XIz] 
It follows that the transfer function of the unit delay is 


l 


A[z] = — (5.40) 


EXERCISE E5.13 


A discrete-time system is described by the following transfer function: oP 


z—0.5 . 
A(z] = 


a 


(z +0.5)(z — 1) 


a. Find the system response to input x [n]=3"( 
zero. 


n*1)u[n] if all initial conditions are 


b. Write the difference equation relating the output y[n] to input x[n] for this system. 
Answers 

a. Yin} = $[4 —0.8(—0.5)" + 0.3(4)"] ula] 

b. Yin +2] —O0.5y[n + 1] —O.5y[n] = x[n + 1) — 0.5x[n] 


5.3-2 Stability 


Equation (5.34) shows that the denominator of H[z] is Q[z], which is apparently identical to the characteristic polynomial Q[y] defined in 
Chapter 3. Does this mean that the denominator of H[z] is the characteristic polynomial of the system? This may or may not be the 
case: if P[z] and Q[z] in Eq. (5.34) have any common factors, they cancel out, and the effective denominator of H[z] is not necessarily 
equal to Q[z]. Recall also that the system transfer function H[z], like A[n], is defined in terms of measurements at the external 
terminals. Consequently, H[z] and h[n] are both external descriptions of the system. In contrast, the characteristic polynomial Q[z] is an 
internal description. Clearly, we can determine only external stability, that is, BIBO stability, from H[z]. If all the poles of H[z] are within 


the unit circle, all the terms in h[z] are decaying exponentials, and as shown in Section 3.10, h[n] is absolutely summable. 
Consequently, the system is BIBO stable. Otherwise the system is BIBO unstable. 


If P[z] and Q[z] do not have common factors, then the denominator of H[z] is identical to Q{z].!1] The poles of H[z] are the 
characteristic roots of the system. We can now determine internal stability. The internal stability criterion in Section 3.10-1 can be 
restated in terms of the poles of H[z], as follows. 


1. An LTID system is asymptotically stable if and only if all the poles of its transfer function H[z] are within the unit circle. The 
poles may be repeated or simple. 


2. An LTID system is unstable if and only if either one or both of the following conditions exist: (i) at least one pole of H[z] is 
outside the unit circle; (ii) there are repeated poles of H[z] on the unit circle. 


3. An LTID system is marginally stable if and only if there are no poles of H[z] outside the unit circle, and there are some 
simple poles on the unit circle. 


EXERCISE E5.14 
Show that an accumulator whose impulse response is h[n]=u[n] is marginally stable but BIBO unstable. 


5.3-3 Inverse Systems 


If H[z] is the transfer function of a system S, then Sj, its inverse system has a transfer function Hz] given by 
I 
A[z] = —— 
Hiz] 
This follows from the fact the inverse system S; undoes the operation of S. Hence, if H[z] is placed in cascade with H[z], the transfer 


function of the composite system (identity system) is unity. For example, an accumulator, whose transfer function is H[z]=z/(z — 1) and 
a backward difference system whose transfer function is Hj[z]=(z — 1)/z are inverse of each other. Similarly if 


z—0.4 
H{z] = ——— 
z—0.7 

its inverse system transfer function is 
Ris -—-——- 
lz] z—0.4 


as required by the property H[z]H{[z]=1. Hence, it follows that 
h{n] *« h[n] = d[n] 


EXERCISE E5.15 
Find the impulse response of an accumulator and the backward difference system. Show that the convolution of the two impulse 
responses yields 8[n]. 


[t]Another approach is to find y[0], y[1], y[2],..., yiIN — 1] from y[—1], y[-2],..., yi—n] iteratively, as in Section 3.5-1, and then apply the 
left-shift property to Eq. (5.24). 


[Tin computing y[n], the contour along which the integration is performed is modified to consider the ROC of X[z] as well as H[z]. We 
ignore this consideration in this intuitive discussion. 


[tlThere is no way of determining whether there were common factors in P[z] and Q[z] that were canceled out because in our 
derivation of H[z], we generally get the final result after the cancellations are already effected. When we use internal description of the 
system to derive Q[z], however, we find pure Q[z] unaffected by any common factor in P[z]. 


5.4 SYSTEM REALIZATION 


Because of the similarity between LTIC and LTID systems, conventions for block diagrams and rules of interconnection for LTID are 
identical to those for continuous-time (LTIC) systems. It is not necessary to rederive these relationships. We shall merely restate them to 
refresh the reader's memory. 


The block diagram representation of the basic operations such as an adder a scalar multiplier, unit delay, and pick off points were 
shown in Fig. 3.11. In our development, the unit delay, which was represented by a box marked D in Fig. 3.11, will be represented by 
its transfer function 1/z. All the signals will also be represented in terms of their z-transforms. Thus, the input and the output will be 
labeled X[z] and Y[z], respectively. 


When two systems with transfer functions H[z] and H2[z] are connected in cascade (as in Fig. 4.18b), the transfer function of the 
composite system is H7[z]H2[z]. If the same two systems are connected in parallel (as in Fig. 4.18c), the transfer function of the 
composite system is H7[z]H2[z]. For a feedback system (as in Fig. 4.18d), the transfer function is G[z]/(1 + G[z]H[z]). 


We now consider a systematic method for realization (or simulation) of an arbitrary Nth-order LTID transfer function. Since realization is 
basically a synthesis problem, there is no unique way of realizing a system. A given transfer function can be realized in many different 
ways. We present here the two forms of direct realization. Each of these forms can be executed in several other ways, such as cascade 
and parallel. Furthermore, a system can be realized by the transposed version of any known realization of that system. This artifice 
doubles the number of system realizations. A transfer function H[z] can be realized by using time delays along with adders and 
multipliers. 


We shall consider a realization of a general Nth-order causal LTID system, whose transfer function is given by 


boz® + byz¥—! +++» + by_iz + by 


= —; 
l= ai!) + + avant + aN 


(5.41) 

This equation is identical to the transfer function of a general Nth-order proper LTIC system given in Eq. (4.60). The only difference is 
that the variable z in the former is replaced by the variable s in the latter. Hence, the procedure for realizing an LTID transfer function 
is identical to that for the LTIC transfer function with the basic element 1/s (integrator) replaced by the element 1/z (unit delay). The 
reader is encouraged to follow the steps in Section 4.6 and rederive the results for the LTID transfer function in Eq. (5.41). Here we 
shall merely reproduce the realizations from Section 4.6 with integrators (1/s) replaced by unit delays (1/z). The direct form | (DF1) is 
shown in Fig. 5.8a, the canonic direct form (DFII) is shown in Fig. 5.8b and the transpose of canonic direct is shown in Fig. 5.8c. The 
DFIl and its transpose are canonic because they require N delays, which is the minimum number needed to implement an Nth-order 
LTID transfer function in Eq. (5.41). In contrast, the form DFI is a noncanonic because it generally requires 2N delays. The DFII 
realization in Fig. 5.8b is also called a canonic direct form. 


( 


Figure 5.8: Realization of an Nth-order causal LTID system transfer function by using (a) DFI, (b) canonic direct (DFII), and (c) the 
transpose form of DFIl. 


EXAMPLE 5.8 
Find the canonic direct and the transposed canonic direct realizations of the following transfer functions. 


rid 
~ 


ii, Z+7 
47 +28 
iv. 2 +6z+5 
All four of these transfer functions are special cases of H[z] in Eq. (5.41). 


A[z] = 
i. £+5 

For this case, the transfer function is of the first order (N=1); therefore, we need only one delay for its realization. The 

feedback and feedforward coefficients are 


a=5 and b=0, b =2 


We use Fig. 5.8 as our model and reduce it to the case of N=1. Figure 5.9a shows the canonic direct (DFII) form, and Fig. 
5.9b its transpose. The two realizations are almost the same. The minor difference is that in the DFIl form, the gain 2 is 
provided at the output, and in the transpose, the same gain is provided at the input. 


Y[z] 


X\z] 


‘ > X{z] 


(a) {b) 
Figure 5.9: Realization of transfer function 2/(z + 5): (a) canonic direct form and (b) its transpose. 


In a similar way, we realize the remaining transfer functions. 


In this case also, the transfer function is of the first order (N=1); therefore, we need only one delay for its realization. The 
feedback and feedforward coefficients are 


a=1 and bo =4, b, =28 


Figure 5.10 illustrates the canonic direct and its transpose for this case._|T] 


Ml ba Fa Xz] 4 Ye] 


(a) (b> 


Figure 5.10: Realization of (4z + 28)/(z + 1): (a) canonic direct form and (b) its transpose. 


4 
~ 


A{[z] = 
ili. z+7 
Here N=1 and bg=1, b4=0 and a4=7. Figure 5.11 shows the direct and the transposed realizations. Observe that the 
realizations are almost alike. 
XTzl Y[z] 


XTz] YIz] 


(a) {b) 


Figure 5.11: Realization of z/(z + 7): (a) canonic direct form and (b) its transpose. 


This is a second-order system (N = 2) with bo = 0, by = 4, bo = 28, a1 = 6, ag = 5. Figure 5.12 shows the canonic direct 
and transposed canonic direct realizations. 


Figure 5.12: Realization of (4z + 28)\(z? + 6z + 5): (a) canonic direct form and (b) its transpose. 


EXERCISE E5.16 
Realize the transfer function 


2z 
Wel = 462425 


CASCADE AND PARALLEL REALIZATIONS, COMPLEX AND REPEATED POLES 


The considerations and observations for cascade and parallel realizations as well as complex and multiple poles are identical to those 
discussed for LTIC systems in Section 4.6-3. 


EXERCISE E5.17 
Find canonic direct realizations of the following transfer function by using the cascade and parallel forms. The specific cascade 
decomposition is as follows: 


z+3 z+3 l 
z*+7z+10 z+2 z+5 


REALIZATION OF FINITE IMPULSE RESPONSE (FIR) FILTERS 


So far we have been quite general in our development of realization techniques. They can be applied to infinite impulse response (IIR) 
or FIR filters. For FIR filters, the coefficients a; = 0 for all i + 0.[t] Hence, FIR filters can be readily implemented by means of the 
schemes developed so far by eliminating all branches with a; coefficients. The condition a; = 0 implies that all the poles of a FIR filter 
are at z =0. 


EXAMPLE 5.9 
Realize H [z] = (z? +4z2+5z+ 2)iz3 using canonic direct and transposed forms. 


We can express H[z] as 
z34+4277+5z+2 
H[z] = ———_—— 


z3 


For H[z], bp = 1, by = 4, b2 = 5, and b3 = 2. Hence, we obtain the canonic direct realization, shown in Fig. 5.13a. We have shown the 


horizontal orientation because it is easier to see that this filter is basically a tapped delay line. That is why this structure is also known 
as a tapped delay line or transversal filter. Figure 5.13b shows the corresponding transposed implementation. 


X{z] 


(b) 
Figure 5.13: Realization of (z° + 4z2 + 5z + 2)/z°. 


DO ALL REALIZATIONS LEAD TO THE SAME PEREORMANCE? 


For a given transfer function, we have presented here several possible different realizations (DFl, canonic form DFIl, and its transpose). 
There are also cascade and parallel versions, and there are many possible grouping of the factors in the numerator and the 
denominator of H[z], leading to different realizations. We can also use various combinations of these forms in implementing different 
subsections of a system. Moreover, the transpose of each version doubles the number. However, this discussion by no means exhausts 
all the possibilities. Transforming variables affords limitless potential realizations of the same transfer function. 


Theoretically, all these realizations are equivalent; that is, they lead to the same transfer function. This, however, is true only when we 
implement them with infinite precision. In practice, finite wordlength restriction causes each realization to behave differently in terms of 
sensitivity to parameter variation, stability, frequency response distortion error, and so on. These effects are serious for higher-order 
transfer functions, which require correspondingly higher numbers of delay elements. The finite wordlength errors that plague these 
implementations are coefficient quantization, overflow errors, and round-off errors. From a practical viewpoint, parallel and cascade 
forms using low-order filters minimize the effects of finite wordlength. Parallel and certain cascade forms are numerically less sensitive 
than the canonic direct form to small parameter variations in the system. In the canonic direct form structure with large N, a small 
change in a filter coefficient due to parameter quantization results in a large change in the location of the poles and the zeros of the 
system. Qualitatively, this difference can be explained by the fact that in a direct form (or its transpose), all the coefficients interact with 
each other, and a change in any coefficient will be magnified through its repeated influence from feedback and feedforward connections. 
In a parallel realization, in contrast, a change in a coefficient will affect only a localized segment; the case of a cascade realization is 
similar. For this reason, the most popular technique for minimizing finite wordlength effects is to design filters by using cascade or 
parallel forms employing low-order filters. In practice, high-order filters are realized by using multiple second-order sections in cascade, 
because second-order filters are not only easier to design but are less susceptible to coefficient quantization and round-off errors and 
their implementations allow easier data word scaling to reduce the potential overflow effects of data word size growth. A cascaded 


system using second-order building blocks usually requires fewer multiplications for a given filter frequency response.!1] 
There are several ways to pair the poles and zeros of an Nth-order H[z] into a cascade of second-order sections, and several ways to 
order the resulting sections. Quantizing error will be different for each combination. Although several papers published provide 


guidelines in predicting and minimizing finite wordlength errors, it is advisable to resort to computer simulation of the filter design. This 
way, one can vary filter hardware characteristic, such as coefficient wordlengths, accumulator register sizes, sequencing of cascaded 


sections, and input signal sets. Such an approach is both reliable and economical. !1] 


[tlTransfer functions with N=M may also be expressed as a sum of a constant and a strictly proper transfer function. For example, 


4z+ 28 24 
H[z] = ——— =4+ 
z+l1 z+1 


Hence, this transfer function can also be realized as two transfer functions in parallel. 


[t]This statement is true for all i + 0 because ao is assumed to be unity. 


[]Lyons, R. G. Understanding Digital Signal Processing. Addison-Wesley, Reading, MA, 1997. 


5.5 FREQUENCY RESPONSE OF DISCRETE-TIME SYSTEMS 


For (asymptotically or BIBO-stable) continuous-time systems, we showed that the system response to an input el ig H(ju)e/# and 


that the response to an input cos wt is |H(jw)| cos [wt + ZH(ju)]. Similar results hold for discrete-time systems. We now show that for 
an (asymptotically or BIBO-stable) LTID system, the system response to an input JON ig Hel] eiQn and the response to an input cos 
Qn is |H{e/@]| cos (Qn + ZH{e/). 


The proof is similar to the one used for continuous-time systems. In Section 3.8-3, we showed that an LTID system response to an 


(everlasting) exponential z” is also an (everlasting) exponential H[z]z” This result is valid only for values of z for which H[z], as defined 
in Eq. (5.14a), exists (converges). As usual, we represent this input-output relationship by a directed arrow notation as 


2" ==> H[z)z" (5.42) 
Setting z = e/2 in this relationship yields 
ef — H[ei@}eian (5.43) 


Noting that cos Qn is the real part of e/Qn use of Eq. (3.66b) yields 
cos Qn => Re {H[e’* Je/™} (5.44) 


Expressing Hel} in the polar form 


Hfe!] = |e! eit") (5.45) 


Eq. (5.44) can be expressed as 
cos Qn => |H[e!@]| cos (Qn + LH{e?*}) 


In other words, the system response y[n] to a sinusoidal input cos On is given by 


y[n] = | He }| cos (Qn + LHfe’*]) (5.46a) 


Following the same argument, the system response to a sinusoid cos (Qn + 6) is 


yin] = |He!*}| cos (Qn + 0 + LH[e/*}) (5.46b) 
This result is valid only for BIBO-stable or asymptotically stable systems. The frequency response is meaningless for BIBO-unstable 
systems (which include marginally stable and asymptotically unstable systems). This follows from the fact that the frequency response in 
Eq. (5.43) is obtained by setting z = e/2 in Eq. (5.42). But, as shown in Section 3.8-3 [Eqs. (3.71)], the relationship (5.42) applies only 
for values of z for which H[z] exists. For BIBO unstable systems, the ROC for H[z] does not include the unit circle where z = e/. This 
means, for BIBO-unstable systems, that H[z] is meaningless when z = Olt] 


This important result shows that the response of an asymptotically or BIBO-stable LTID system to a discrete-time sinusoidal input of 
frequency Q is also a discrete-time sinusoid of the same frequency. The amplitude of the output sinusoid is |H{e/} times the input 
amplitude, and the phase of the output sinusoid is shifted by ZH{elQ| with respect to the input phase. Clearly |H[e/} is the amplitude 
gain, and a plot of |H{e/} versus is the amplitude response of the discrete-time system. Similarly, ZHelQ} is the phase response of 


the system, and a plot of ZHe!2 versus © shows how the system modifies or shifts the phase of the input sinusoid. Note that Hel] 
incorporates the information of both amplitude and phase responses and therefore is called the frequency responses of the system. 


STEADY-STATE RESPONSE TO CAUSAL SINUSOIDAL INPUT 


As in the case of continuous-time systems, we can show that the response of an LTID system to a causal sinusoidal input cos Qn u[n] 
is y[n] in Eq. (5.46a), plus a natural component consisting of the characteristic modes (see Prob. 5.5-6). For a stable system, all the 
modes decay exponentially, and only the sinusoidal component in Eq. (5.46a) persists. For this reason, this component is called the 
sinusoidal steady-state response of the system. Thus, yz,[n], the steady-state response of a system to a causal sinusoidal input cos 


Qn u[n], is 


Vein] = |H le? | cos (Qn + ZH[e!*})uln] 
SYSTEM RESPONSE TO SAMPLED CONTINUOUS-TIME SINUSOIDS 


So far we have considered the response of a discrete-time system to a discrete-time sinusoid cos On (or exponential fn). In practice, 


the input may be a sampled continuous-time sinusoid cos wt (or an exponential elt), When a sinusoid cos wt is sampled with 
sampling interval T, the resulting signal is a discrete-time sinusoid cos wnT, obtained by setting t= nT in cos wt. Therefore, all the 
results developed in this section apply if we substitute wT for Q: 


2 = wT (5.47) 
EXAMPLE 5.10 


For a system specified by the equation 


y[n + 1] — 0.8y[n] = x[n + 1] 


find the system response to the input 


a. 1" =1 

4 

aa 2] 
._ 00s [=n 0 


c. a sampled sinusoid cos 1500¢ with sampling interval T = 0.001 


The system equation can be expressed as 


(E — 0.8)y[n] = Ex[n] 
Therefore, the transfer function of the system is 


H{z] = 


z 
z-08 1-0.82-! 
The frequency response is 


re 
aid ia 1 —0.8¢e-/8 
_ l 
~ 1-0.8(cos 2 — j sin Q) 
1 
se —————————————————— 5.48 
(1 —0.8cos Q) + j0.8 sin Q ( ) 
Therefore 
a l 
Ae QQ) = ——— 
(1 — 0.8 cos $2)* + (0.8 sin $2) 
a (5.49a) 
/1.64 — 1.6 cos 2 
and 
- 0.8 sin Q 
£H{e!*| = — tan! eS 5.49b 
le 1—0.8cos 2 ene 


The amplitude response |Hfe/2}| can also be obtained by observing that |H|2=HH*. Therefore 
|Hle/*]? = He! ]H"[e’*] 
= H{e’*|H[e/*| (5.50) 
From Eq. (5.48) it follows that ' 
wate"? = (7=saews) (Tae) “ Tease 
which yields the result found earlier in Eq. (5.49a) 


Figure 5.14 shows plots of amplitude and phase response as functions of O. We now compute the amplitude and the phase response 
for the various inputs. 


a. x[n]=1" =1 
Since qn=eiQ)n with QO = 0, the amplitude response is H{e!%}. From Eq. (5.49a) we obtain 
P 1 
H{e**) = ————_. = —— =5=50 


Therefore 


\Hfei=5 and  ZAfe]=0 


These values also can be read directly from Fig. 5.14a and 5.14b, respectively, corresponding to © = 0. Therefore, the 
system response to input 1 is 


y[n] = 51") =5 for all n (5.51) 
. X[n] = cos[(1t/6)n —0.2] 
Here © = 11/6. According to Eqs. (5.49) 


; | 
|H[e/*}| = = 1.983 
1.64 — 1.6cos — 
\ 6 
0.8 sin = 
H{e!*/®| = —tan! | ———2| = -0.916 rad 
1 — 0.8 cos ’ 


These values also can be read directly from Fig. 5.14a and 5.14b, respectively, corresponding to QO=tr/6. Therefore 


yin] = 1.983 cos (=n ~02- 0.916) 


= 1.983 cos (Zn Z 1.116) (5.52) 


Figure 5.15 shows the input x[n] and the corresponding system response. 


Figure 5.15: Sinusoidal input and the corresponding output of the LTID system. 


“oO 


. Asinusoid cos 1500t¢ sampled every T seconds (f = nT) results in a discrete-time sinusoid 


x[n] = cos 1500nT (5.53) 


For T= 0.001, the input is 
x[n] = cos (1.57) 


In this case, QO =1.5. According to Eqs. (5.49a) and (5.49b), 
1 


Hie] = ——————————— _ = 0.809 5.54 
Halen /1.64 — 1.6 cos (1.5) ae) 
0.8 sin (1.5) 
LAle!*] = —tan™! ee = —0.702 rad . 
le") 1 — 0.8 cos (1.5) 65) 


These values also could be read directly from Fig. 5.14 corresponding to O =1.5. Therefore 


y[n] = 0.809 cos (1.5n — 0.702) 


(a 
+ sh07° a 
P9 = = oe o— 
ae ita Le 


tb) 


Figure 5.14: Frequency response of the LTID system. 


COMPUTER EXAMPLE C5.1 
Using MATLAB, find the frequency response of the system in Example 5.10. 


>> Omega = linspace(-pi,pi,400); 

>> H= tf ( [1 0], [1 -0.8],-1); 

>> H Omega = squeeze (freqresp (H,Omega) ); 

>> subplot (2,1,1); plot (Omega, abs(H Omega), 'k'); axis tight; 

>> xlabel ('\Omega'); ylabel('|H[e*{j VOmega}]|'); 

>> subplot (2,1,2); plot (Omega, angle (H Omega) * 180/pi, 'k'); axis tight; 
>> xlabel ('\Omega'); ylabel ('\angle H[e*{j \Omega}] [deg]'); 


4.5 
4 
= 35 
é : 
ae 
— 
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{) 
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18) 
Figure C5.1 


Comment. Figure 5.14 shows plots of amplitude and phase response as functions of Q. These plots as well as Eqs. (5.49) indicate that 
the frequency response of a discrete-time system is a continuous (rather than discrete) function of frequency Q. There is no 
contradiction here. This behavior is merely an indication of the fact that the frequency variable Q is continuous (takes on all possible 
values) and therefore the system response exists at every value of Q. 


EXERCISE E5.18 


For a system specified by the equation oF 
y[n + 1] — 0.5 y[n] = x[n] . 


find the amplitude and the phase response. Find the system response to sinusoidal input cos (100¢ — (11/3)) 
sampled every T = 0.5 ms. 


Answers 


2 I 
qe)! = ——_—_—_—— 
ated V1.25 — cos & 
, sin Q 
£H{e!™] = — tan"! -— 
ed = [cos 2 — 0.5 


y{n] = 1.639 cos (0. - - - 0.904 ) = 1.639 cos (0.5n — 1.951) 


EXERCISE E5.19 


Show that for an ideal delay (H[z]=1/z), the amplitude response |H{e/™|=1, and the phase response ZHle]= —Q. Thus, a pure time 
delay does not affect the amplitude gain of sinusoidal input, but it causes a phase shift (delay) of O radians in a discrete sinusoid of 
frequency ©. Thus, for an ideal delay, the phase shift of the output sinusoid is proportional to the frequency of the input sinusoid (linear 
phase shift). 


5.5-1 The Periodic Nature of the Frequency Response 


In Example 5.10 and Fig. 5.14, we saw that the frequency response Hel] is a periodic function of QO. This is not a coincidence. Unlike 
continuous-time systems, all LTID systems have periodic frequency response. This is seen clearly from the nature of the expression of 


the frequency response of an LTID system. Because et/2TM=4 for all integer values of m [see Eq. (B.12)], 
Ale] = H[ei** es) m integer (5.56) 


Therefore the frequency response Hel} is a periodic function of OQ with a period 2tr. This is the mathematical explanation of the 
periodic behavior. The physical explanation that follows provides a much better insight into the periodic behavior. 


NONUNIQUENESS OF DISCRETE-TIME SINUSOID WAVEFORMS 


A continuous-time sinusoid cos wt has a unique waveform for every real value of w in the range 0 to . Increasing w results in a 
sinusoid of ever increasing frequency. Such is not the case for the discrete-time sinusoid cos Qn because 


cos[(Q + 27m)n] = cos Qn m integer (5.57a) 


and 
ei (Rt2nm\n yin m integer (5.57b) 


This shows that the discrete-time sinusoids cos Qn (and exponentials Qn) separated by values of Q in integral multiples of 2T are 
identical. The reason for the periodic nature of the frequency response of an LTID system is now clear. Since the sinusoids (or 
exponentials) with frequencies separated by interval 211 are identical, the system response to such sinusoids is also identical and, 
hence, is periodic with period 2tr. 


This discussion shows that the discrete-time sinusoid cos Qn has a unique waveform only for the values of Q in the range —Tr to TT. 
This band is called the fundamental band. Every frequency ©, no matter how large, is identical to some frequency, Og, in the 


fundamental band (— TT < Og < TT), where 
Q, =Q—227m —~27<=2,<2 and ™m integer (5.58) 


The integer m can be positive or negative. We use Eq. (5.58) to plot the fundamental band frequency OQ, versus the frequency O ofa 
sinusoid (Fig. 5.16a). The frequency Q, is modulo 2tr value of OQ. 


All these conclusions are also valid for exponential e/2”, 


ALL DISCRETE-TIME SIGNALS ARE INHERENTLY BANDLIMITED 

This discussion leads to the surprising conclusion that all discrete-time signals are inherently bandlimited, with frequencies lying in the 
range —Tr to Tt radians per sample. In terms of frequency F = Q)/27 where F is in cycles per sample, all frequencies F separated 
by an integer number are identical. For instance, all discrete-time sinusoids of frequencies 0.3, 1.3, 2.3, ...cycles per sample are 
identical. The fundamental range of frequencies is —0.5 to 0.5 cycles per sample. 


Any discrete-time sinusoid of frequency beyond the fundamental band, when plotted, appears and behaves, in every way, like a 
sinusoid having its frequency in the fundamental band. It is impossible to distinguish between the two signals. Thus, in a basic sense, 
discrete-time frequencies beyond |Q| = Tr or \F| = 1/2 do not exist. Yet, in a "mathematical" sense, we must admit the existence of 
sinusoids of frequencies beyond © = tr. What does this mean? 


A MAN NAMED ROBERT 

To give an analogy, consider a fictitious person Mr. Robert Thompson. His mother calls him Robby; his acquaintances call him Bob, his 
close friends call him by his nickname, Shorty. Yet, Robert, Robby, Bob, and Shorty are one and the same person. However, we cannot 
say that only Mr. Robert Thompson exists, or only Robby exists, or only Shorty exists, or only Bob exists. All these four persons exist, 
although they are one and the same individual. In a same way, we cannot say that the frequency Tt/2 exists and frequency 51t/2 does 
not exist; they are both the same entity, called by different names. 


It is in this sense that we have to admit the existence of frequencies beyond the fundamental band. Indeed, mathematical expressions 
in frequency-domain automatically cater to this need by their built-in periodicity. As seen earlier, the very structure of the frequency 
response is 2Tt periodic. We shall also see later, in Chapter 9, that discrete-time signal spectra are also 2Tt periodic. 


Admitting the existence of frequencies beyond Tr also serves mathematical and computational convenience in digital signal processing 
applications. Values of frequencies beyond tr may also originate naturally in the process of sampling continuous-time sinusoids. 
Because there is no upper limit on the value of w, there is no upper limit on the value of the resulting discrete-time frequency Q = wT 


either. [T] 


The highest possible frequency is tr and the lowest frequency is 0 (dc or constant). Clearly, the high frequencies are those in the 
vicinity of OQ = (2m + 1) and the low frequencies are those in the vicinity of OQ = 2t1m for all positive or negative integer values of m. 


FURTHER REDUCTION IN THE FREQUENCY RANGE 

Because cos (—Qn + 8) = cos (On — 8), a frequency in the range —Tr to 0 is identical to the frequency (of the same magnitude) in the 
range 0 to tr (but with a change in phase sign). Consequently the apparent frequency for a discrete-time sinusoid of any frequency is 
equal to some value in the range 0 to Tr. Thus, cos (8.711n + 8) = cos (0.7T1n + 8), and the apparent frequency is 0.71. Similarly, 

cos (9.67 +0) = cos (—0.477n + 0) = cos (0.420 — 0) 

Hence, the frequency 9.6rTr is identical (in every respect) to frequency —0.4TT, which, in turn, is equal (within the sign of its phase) to 
frequency 0.411. In this case, the apparent frequency reduces to |IT,|=0.41. We can generalize the result to say that the apparent 
frequency of a discrete-time sinusoid Q is |Q,|, as found from Eq. (5.58), and if O, < 0, there is a phase reversal. Figure 5.16b plots O 
versus the apparent frequency |Q,|. The shaded bands represent the ranges of 0 for which there is a phase reversal, when 
represented in terms of |O,|. For example, the apparent frequency for both the sinusoids cos (2.41 + 8) and cos (3.611 + 9) is |O,| = 


0.411, as seen from Fig. 5.16b. But 2.411 is in a clear band and 3.6Tt is in a shaded band. Hence, these sinusoids appear as cos (0.411 
+ 8) and cos (0.41r — 8), respectively. 


ib) 


Figure 5.16: (a) Actual frequency versus (b) apparent frequency. 


Although every discrete-time sinusoid can be expressed as having frequency in the range from 0 to Tr, we generally use the frequency 
range from —Tr to Tr instead of 0 to Tt for two reasons. First, exponential representation of sinusoids with frequencies in the range 0 to 
TT requires a frequency range —Trt to Tr. Second, even when we are using trigonometric representation, we generally need the 
frequency range —Tr to Tt to have exact identity (without phase reversal) of a higher-frequency sinusoid. 


For certain practical advantages, in place of the range —Tr to Tr, we often use other contiguous ranges of width 2tTr. The range 0 to 2Tr, 
for instance, is used in many applications. It is left as an exercise for the reader to show that the frequencies in the range from Tr to 
2Tt are identical to those in the range from —Tr to 0. 


EXAMPLE 5.11 
Express the following signals in terms of their apparent frequencies. 


a. cos (0.511n + 8) 
b. cos (1.611n + 8) 


c. sin (1.611n + 8) 


d. cos (2.31tn + 8) 

e. cos (34.699n + 8) 

a. Q = 0.5Tr is in the reduced range already. This is also apparent from Fig. 5.16a or 5.16b. Because 0, = 0.5t1T, and there 
is no phase reversal, and the apparent sinusoid is cos (0.51rn + 8). 

b. We express 1.61 = —0.4Tt + 271 so that O, = —0.4 and [O,| = 0.4. Also, QO, is negative, implying sign change for the 
phase. Hence, the apparent sinusoid is cos (0.411n — i). This fact is also apparent from Fig. 5.16b. 

c. We first convert the sine form to cosine form as sin (1.61tn + 8) = cos (1.611 — (11/2) 8). In part (b) we found O, = 
—0.411. Hence, the apparent sinusoid is cos (0.411n + (11/2) + 8) = —sin (0.411n — 8). In this case, both the phase and 
the amplitude change signs. 

d. 2.311 = 0.311 + 211 so that ON, = 0.311. Hence, the apparent sinusoid is cos (0.311 n + 8). 

e. We have 34.699 = -3 + 6(2Tr). Hence, O, = —3, and the apparent frequency |Q,| = 3 rad/sample. Because 0. is 
negative, there is a sign change of the phase. Hence, the apparent sinusoid is cos (3n — 8). 

EXERCISE E5.20 
Show that the sinusoids having frequencies Q of 

a. 2TT 

b. 31 

c. ST 

d. 3.217 

e. 22.1327 

f. m+2 


can be expressed, respectively, as sinusoids of frequencies 


e. 


. 0 


f. 1T-2 


Show that in cases (d), (e), and (f), phase changes sign. 


5.5-2 Aliasing and Sampling Rate 


The nonuniqueness of discrete-time sinusoids and the periodic repetition of the same waveforms at intervals of 2T may seem 
innocuous, but in reality it leads to a serious problem for processing continuous-time signals by digital filters. A continuous-time sinusoid 
cos wt sampled every T seconds (t=nT) results in a discrete-time sinusoid cos wT, which is cos On with Q=wT. The discrete-time 
sinusoids cos On have unique waveforms only for the values of frequencies in the range w < Tr or wT < Tr. Therefore samples of 


continuous- 


time sinusoids of two (or more) different frequencies can generate the same discrete-time signal, as shown in Fig. 5.17. This 


phenomenon is known as aliasing because through sampling, two entirely different analog sinusoids take on the same "discrete-time" 


identity.[T1 


Figure 


5.17: Demonstration of aliasing effect. 


Aliasing causes ambiguity in digital signal processing, which makes it impossible to determine the true frequency of the sampled signal. 
Consider, for instance, digitally processing a continuous-time signal that contains two distinct components of frequencies wy, and Wo. 
The samples of these components appear as discrete-time sinusoids of frequencies QO, = wT and Oo = TiaT. If O41 and we happen to 
differ by an integer multiple of 2Tr (if w2 — Ww 4=2kTrIT), the 


two frequencies will be read as the same (lower of the two) frequency by the digital processor.!T] As a result, the higher-frequency 
component Ww. not only is lost for good (by losing its identity to w 4), but it reincarnates as a component of frequency w,, thus distorting 
the true amplitude of the original component of frequency w4. Hence, the resulting processed signal will be distorted. Clearly, aliasing 


is highly undesirable and should be avoided. To avoid aliasing, the frequencies of the continuous-time sinusoids to be processed should 
be kept within the fundamental band wT < Tr or w < Tr/T. Under this condition the question of ambiguity or aliasing does not arise 
because any continuous-time sinusoid of frequency in this range has a unique waveform when it is sampled. Therefore if wy is the 
highest frequency to be processed, then, to avoid aliasing, 


,( 4 
Op, <= Tr (5.59) 


If f, is the highest frequency in hertz, f, = w,/2TT, and, according to Eq. (5.59), 
Sh oi (5.60a) 
or 


T < 


(5.60b) 
2 fh 
This shows that discrete-time signal processing places the limit on the highest frequency f, that can be processed for a given value of 


the sampling interval T according to Eq. (5.60a). But we can process a signal of any frequency (without aliasing) by choosing a suitable 
value of T according to Eq. (5.60b). The sampling rate or sampling frequency f, is the reciprocal of the sampling interval T, and, 
according to Eq. (5.60b), 


1 
f= p> 2h (5.61a) 
so that 
fi < & (5.61b) 


This result is a special case of the well-known sampling theorem (to be proved in Chapter 8). It states that to process a continuous- 
time sinusoid by a discrete-time system, the sampling rate must be greater than twice the frequency (in hertz) of the sinusoid. In short, 
a sampled sinusoid must have a minimum of two samples per cycle.[T] For sampling rate below this minimum value, the output signal 
will be aliased, which means it will be mistaken for a sinusoid of lower frequency. 


ANTIALIASING FILTER 

If the sampling rate fails to satisfy condition (5.61), aliasing occurs, causing the frequencies beyond f,/2 Hz to masquerade as lower 
frequencies to corrupt the spectrum at frequencies below f,/2. To avoid such a corruption, a signal to be sampled is passed through an 
antialiasing filter of bandwidth f,/2 prior to sampling. This operation ensures the condition (5.61). The drawback of such a filter is that 
we lose the spectral components of the signal beyond frequency f,/2, which is a preferable alternative to the aliasing corruption of the 
signal at frequencies below f,/2. Chapter 8 presents a detailed analysis of the aliasing problem. 


EXAMPLE 5.12 


Determine the maximum sampling interval T that can be used in a discrete-time oscillator which generates a sinusoid of 50 kHz. 


Here the highest significant frequency f,=50 kHz. Therefore from Eq. (5.60b) 
I 
T < —=10ps 
2fh 
The sampling interval must be less than 10us. The sampling frequency is fs=1/T > 100 kHz. 
EXAMPLE 5.13 


A discrete-time amplifier uses a sampling interval T=25 us. What is the highest frequency of a signal that can be processed with this 
amplifier without aliasing? 


From (5.60a) 
th < aT = 20 kHz 


[t]This may also be argued as follows. For BIBO-unstable systems, the zero-input response contains nondecaying natural mode terms 
of the form cos On or y " cos On (y > 1). Hence, the response of such a system to a sinusoid cos On will contain not just the sinusoid 
of frequency © but also nondecaying natural modes, rendering the concept of frequency response meaningless. Alternately, we can 
argue that when z = e/®, a BIBO-unstable system violates the dominance condition |y;| < jel for all i, where yi represents ith 
characteristic root of the system (see Section 4.3). 


[TlHowever, if O goes beyond Tr, the resulting aliasing reduces the apparent frequency to QO, < Tr. 


[tlFigure 5.17 shows samples of two sinusoids cos 121tf and cos 2tTrt taken every 0.2 second. The corresponding discrete-time 
frequencies (O=w T=0.2w) are cos 2.41 and cos 0.411. The apparent frequency of 2.411 is 0.411, identical to the discrete-time 
frequency corresponding to the lower sinusoid. This shows that the samples of both these continuous-time sinusoids at 0.2-second 
intervals are identical, as verified from Fig. 5.17. 


[Tin the case shown in Fig. 5.17, W4=12TT, W2=2TT, and T=0.2. Hence, wz — w7=10TrT=2Tr, and the two frequencies are read as the 
same frequency 0=0.4Tt by the digital processor. 


[T]Strictly speaking, we must have more than two samples per cycle. 


5.6 FREQUENCY RESPONSE FROM POLE-ZERO LOCATION 


The frequency responses (amplitude and phase responses) of a system are determined by pole-zero locations of the transfer function 
H[z]. Just as in continuous-time systems, it is possible to determine quickly the amplitude and the phase response and to obtain 
physical insight into the filter characteristics of a discrete-time system by using a graphical technique. The general Nth-order transfer 
function H[z] in Eq. (5.34) can be expressed in factored form as 
(z — Z1)(Z — 22) °+- (2 — Zw) 
H[z] = by 


nana EnEnE EEE (5.62) 
(Z — V1 )(Z — Ya) + * (Z — Yn) 


We can compute H[z] graphically by using the concepts discussed in Section 4.10. The directed line segment from z; to z in the 
complex plane (Fig. 5.18a) represents the complex number z — z;. The length of this segment is |z — z;| and its angle with the 
horizontal axis is 2(Z — Z)j). 


)) 


Figure 5.18: Vector representations of (a) complex numbers and (b) factors of H[z]. 
To compute the frequency response He! we evaluate H[z] at z = e/2. But for z = el, |z| = 1 and 2z =O so that z = JQ represents 
a point on the unit circle at an angle QO with the horizontal. We now connect all zeros (Z1, Z9, ..., Zxy) and all poles (yj, ya, ..., Yx) to 
the point e/®, as indicated in Fig. 5.18b. Let ry,ro,...,7~y be the lengths and f, fo, ..., Py be the angles, respectively, of the straight lines 
connecting Z1, Zo, ..., Zxyy to the point elQ. Similarly, let d4, do,..., dj be the lengths and 74, ?9,..., 8, be the angles, respectively, of the 
lines connecting y1, Y2,.-., Yn to e/2. Then 


(rie!™ )(rze9*) - + (rwet™) 


wo (5.63) 
(dye!% )(dye/®) - «+ (dyes?) 


Hfe!"] = H[zIl--.0e = 


; Wifa°::Fw EllOrtdrt-+ON)- GO, 4Or++OV)] (5.64) 
d;d> oe -dx 


Therefore (assuming bo < 0) 


=D 


> Mylp- ++ Tr 
H e* te bh mh l_AeliiarnN. . U8 
re Nady 
roduct of the distances of zeros to e/@ 
= TP cia a nena (5.65a) 
product of distances of poles to e/* 
and 
LHfe!™] = (by + br + + bw) — (Oy, +O +-<* + Oy) 
= sum of zero angles to e/” — sum of pole angles to e/ (5.65b) 


In this manner, we can compute the frequency response He] for any value of O by selecting the point on the unit circle at an angle 
Q. This point is 2. To compute the frequency response He), we connect all poles and zeros to this point and use the foregoing 


equations to determine |H{e/®}| and ZHle!]. We repeat this procedure for all values of Q from 0 to Tr to obtain the frequency 
response. 


CONTROLLING GAIN BY PLACEMENT OF POLES AND ZEROS 
The nature of the influence of pole and zero locations on the frequency response is similar to that observed in continuous-time systems, 
with minor differences. In place of the imaginary axis of the continuous-time systems, we have the unit circle in the discrete-time case. 


The nearer the pole (or zero) is to a point JQ (on the unit circle) representing some frequency ©, the more influence that pole (or zero) 


wields on the amplitude response at that frequency because the length of the vector joining that pole (or zero) to the point e/2 is small. 
The proximity of a pole (or a zero) has similar effect on the phase response. From Eq. (5.65a), it is clear that to enhance the amplitude 


response at a frequency OQ, we should place a pole as close as possible to the point JO (which is on the unit circle). {11 Similarly, to 


suppress the amplitude response at a frequency ©, we should place a zero as close as possible to the point e/© on the unit circle 
Placing repeated poles or zeros will further enhance their influence. 


Total suppression of signal transmission at any frequency can be achieved by placing a zero on the unit circle at a point corresponding 
to that frequency. This observation is used in the notch (bandstop) filter design. 


Placing a pole or a zero at the origin does not influence the amplitude response because the length of the vector connecting the origin 


to any point on the unit circle is unity. However, a pole (or a zero) at the origin adds angle —Q (or Q) to Ze. Hence, the phase 
spectrum —O (or Q) is a linear function of frequency and therefore represents a pure time delay (or time advance) of T seconds (see 
Exercise E5.19). Therefore, a pole (a zero) at the origin causes a time delay (or a time advance) of T seconds in the response. There is 
no change in the amplitude response. 


For a stable system, all the poles must be located inside the unit circle. The zeros may lie anywhere. Also, for a physically realizable 
system, H[z] must be a proper fraction, that is, N > M. If, to achieve a certain amplitude response, we require M > N, we can still make 
the system realizable by placing a sufficient number of poles at the origin to make N = M. This will not change the amplitude response, 
but it will increase the time delay of the response. 


In general, a pole at a point has the opposite effect of a zero at that point. Placing a zero closer to a pole tends to cancel the effect of 
that pole on the frequency response. 


LOWPASS FILTERS 

A lowpass filter generally has a maximum gain at or near QO = 0, which corresponds to point e/9 = 1 on the unit circle. Clearly, placing a 
pole inside the unit circle near the point z = 1 (Fig. 5.19a) would result in a lowpass response. |T] The corresponding amplitude and 
phase response appear in Fig. 5.19a. For smaller values of Q, the point lO (a point on the unit circle at an angle Q) is closer to the 


pole, and consequently the gain is higher. As Q increases, the distance of the point e/” from the pole increases. Consequently the gain 
decreases, resulting in a lowpass characteristic. Placing a zero at the origin does not change the amplitude response but it does modify 
the phase response, as illustrated in Fig. 5.19b. Placing a zero at z = —1, however, changes both the amplitude and the phase 


response (Fig. 5.19c). The point z = —1 corresponds to frequency Q = TI(z = QM = giT = 1). Consequently, the amplitude response 
now becomes more attenuated at higher frequencies, with a zero gain at O = Tr. We can approach ideal lowpass characteristics by 
using more poles staggered near z = 1 (but within the unit circle). Figure 5.19d shows a third-order lowpass filter with three poles near 
z= 1 and a third-order zero at z = —1, with corresponding amplitude and phase response. For an ideal lowpass filter we need an 
enhanced gain at every frequency in the band (0, Qc). This can be achieved by placing a continuous wall of poles (requiring an infinite 
number of poles) opposite this band. 


OOOO? 


Figure 5.19: Various pole-zero configurations and the corresponding frequency responses. 


HIGHPASS FILTERS 

A highpass filter has a small gain at lower frequencies and a high gain at higher frequencies. Such a characteristic can be realized by 
placing a pole or poles near z = —1 because we want the gain at O = Tr to be the highest. Placing a zero at z = 1 further enhances 
suppression of gain at lower frequencies. Figure 5.19e shows a possible pole-zero configuration of the third-order highpass filter with 
corresponding amplitude and phase responses. 


In the following two examples, we shall realize analog filters by using digital processors and suitable interface devices (C/D and D/C), 
as shown in Fig. 3.2. At this point we shall examine the design of a digital processor with the transfer function H[z] for the purpose of 
realizing bandpass and bandstop filters in the following examples. 


As Fig. 3.2 showed, the C/D device samples the continuous-time input x(t) to yield a discrete-time signal x[n], which serves as the 
input to H[z]. The output y[n] of H[z] is converted to a continuous-time signal y(t) by a D/C device. We also saw in Eq. (5.47) that a 
continuous-time sinusoid of frequency 0, when sampled, results in a discrete-time sinusoid O = wT. 


EXAMPLE 5.14: (Bandpass Filter) 
By trial and error, design a tuned (bandpass) analog filter with zero transmission at 0 Hz and also at the highest frequency f, = 500 Hz. 
The resonant frequency is required to be 125 Hz. 


Because fp, = 500, we require T < 1/1000 [see Eq. (5.60b)]. Let us select T = 10-3. [T] Recall that the analog frequencies w 
corresponds to digital frequencies QO = wt. Hence, analog frequencies w = 0 and 1000Tt correspond to 0 = 0 and TT, respectively. The 


gain is required to be zero at these frequencies. Hence, we need to place zeros at JQ corresponding to O = 0 and O = Tr. For QO =0,z 
= e/ = 4; for Q = 11, e@ = —1. Hence, there must be zeros at z = + 1. Moreover, we need enhanced response at the resonant 
frequency w = 25011, which corresponds to Q = tr /4, which, in turn, corresponds to z = elQ = QiT/4, Therefore, to enhance the 
frequency response at w = 250T1, we place a pole in the vicinity of e/T/4 | Because this is a complex pole, we also need its conjugate 
near e/T/4 as indicated in Fig. 5.20a. Let us choose these poles y; and y2 as 

n=lyle"* and »=lyle 7" 

where |y| < 1 for stability. The closer the y is to the unit circle, the more sharply peaked is the response around w = 250Tt. We also 
have zeros at + 1. Hence 


(z — 1)(z + 1) 
(z — Iyle*"*)(z — ly le") 

an | 
_ (5.66) 
2? — J2lylz + ly? 


For convenience we shall choose K = 1. The amplitude response is given by 


; ef ne 
Mle") = ee 
|e4? — |y|ei*/4||ei@ — |yle-iz/4| 


Now, by using Eq. (5.50), we obtain 


H[z]=K 


2(1 — cos 22) 
z x 7 
! + ly? — 2|y| cos (2 *) f + ly — 2[y| cos (2 + *\| 


Figure 5.20b shows the amplitude response as a function of w, as well as O = wT = 1073w for values of |y| = 0.83, 0.96, and 1. As 
expected, the gain is zero at w = 0 and at 500 Hz (w =1000Tr). The gain peaks at about 125 Hz (w =250Tt). The resonance (peaking) 
becomes pronounced as |y| approaches 1. Figure 5.20c shows a canonical realization of this filter [see Eq. (5.66)]. 


|Hfe")|? = (5.67) 


Figure 5.20: Designing a bandpass filter. 


COMPUTER EXAMPLE C5.2 


Use MATLAB to compute and plot the frequency response of the bandpass filter in Example 5.14 for the following cases: 


a. ly| = 0.83 
b. |y| = 0.96 
c. |y| = 0.99 


>> Omega = linspace(-pi,pi,4097); g mag = [0.83 0.96 0.99]; 
>> H = zeros(length(g_mag),length (Omega) ) ; 
>> for m = l:length(g_ mag), 


>> H(m,:) = freqz ( [1 0 -1], [1 -sqrt (2) *g_mag (m) g mag (m) *2], Omega); 
>> end 
>> subplot(2,1,1); plot(Omega,abs (H(1,:)), ie: 
>> Omega,abs(H(2,:)),'k--',Omega, abs (H ie Lj) kee ys 
>> axis tight; xlabel('\Omega' ); ylabel('|H [e a Ga nelnies Se 
>> legend('(a) | \gammal| = 0.83','(b) | \gamma 1 | = 0.96','(c) |\gammal| = 0.99',0) 
>> subplot (2,1,2); plot (Omega, angle (H(1, S)) pg kel pews 
>> Omega, angle (H(2,:)),'k--', Omega, angle (H(3,:)),'k-."); 
>> axis tight; xlabel('\Omega'); ylabel('\angle H[e*(j \Omega)] [rad]'); 
' 


>> legend('(a) |\gamma| = 0.83','(b) |\gamma| = 0.96','(c) |\gamma | = 0.99',0O) 


by = 0.83 
--- fy =0.96 
ly =0.99 


life} 


He") (rad) 


Figure C5.2 


EXAMPLE 5.15: [Notch (Bandstop) Filter] 
Design a second-order notch filter to have zero transmission at 250 Hz and a sharp recovery of gain to unity on both sides of 250 Hz. 
The highest significant frequency to be processed is f, = 400 Hz. 


In this case, T < 1/2f, = 1.25 x 1073. Let us choose T = 107°. For the frequency 250 Hz, Q = 211(250)T = 11/2. Thus, the frequency 
250 Hz is represented by a point QQ = Qiml2 = jon the unit circle, as depicted in Fig. 5.21a. Since we need zero transmission at this 
frequency, we must place a zero at z = eltl2 = j and its conjugate at z = eJT/2 = —j. We also require a sharp recovery of gain on both 
sides of frequency 250 Hz. To accomplish this goal, we place two poles close to the two zeros, to cancel out the effect of the two zeros 
as we move away from the point j (corresponding to frequency 250 Hz). For this reason, let us use poles at +ja with a < 1 for stability. 
The closer the poles are to zeros (the closer the a to 1), the faster is the gain recovery on either side of 250 Hz. The resulting transfer 
function is 


(z—j)\(z+J) 


A(z] = K—— 
(z — ja)(z + ja) 
_ etl 
ha? 
The dc gain (gain at O = 0, or z = 1) of this filter is 
H{ij=K 
1 1+ a? 


Because we require a dc gain of unity, we must select K = (1 + a2y/2. The transfer function is therefore 


(1 +a7)(z* +1) 
Hz] = ————— 5.68 
[z] 2(z* + a?) es 
and according to Eq. Nebel os = 
| H{ei*}|? = a +a cil em 
4 (ei? + a?)(e-J22 + 2) 


_ (L+a’y(1 + cos 22) 
~ 2(1 + a4 + 2a? cos 22) 


Figure 5.21b shows |H[e/®]| for values of a = 0.3, 0.6, and 0.95. Figure 5.21c shows a realization of this filter. 


fhe w/2 
(wo 


Figure 5.21: Designing a notch (bandstop) filter. 


EXERCISE E5.21 


Use the graphical argument to show that a filter with transfer function 
7 — 


z—0.9 
A[z] = —— 
y 
acts like a highpass filter. Make a rough sketch of the amplitude response. 


[t]The closest we can place a pole is on the unit circle at the point representing Q. This choice would lead to infinite gain, but should 
be avoided because it will render the system marginally stable (BIBO unstable). The closer the point to the unit circle, the more 
sensitive the system gain to parameter variations. 


[T]Placing the pole at z = 1 results in maximum (infinite) gain, but renders the system BIBO unstable and hence should be avoided. 


[T]strictly speaking, we need T < 0.001. However, we shall show in Chapter 8 that if the input does not contain a finite amplitude 
component of 500 Hz, 7 = 0.001 is adequate. Generally practical signals satisfy this condition. 


5.7 DIGITAL PROCESSING OF ANALOG SIGNALS 


An analog (meaning continuous-time) signal can be processed digitally by sampling the analog signal and processing the samples by a 
digital (meaning discrete-time) processor. The output of the processor is then converted back to analog signal, as shown in Fig. 5.22a. 
We saw some simple cases of such processing in Examples 3.6, 3.7, 5.14, and 5.15. In this section, we shall derive a criterion for 
designing such a digital processor for a general LTIC system. 


Suppose that we wish to realize an equivalent of an analog system with transfer function Hj(s), shown in Fig. 5.22b. Let the digital 
processor transfer function in Fig. 5.22a that realizes this desired H3(s) be H[z]. In other words, we wish to make the two systems in 
Fig. 5.22 equivalent (at least approximately). 


By "equivalence" we mean that for a given input x(t), the systems in Fig. 5.22 yield the same output y(t). Therefore y(n7T), the samples 


of the output in Fig. 5.22b, are identical to y[n], the output of H[z] in Fig. 5.22a. 


ao Continuous to Xf] Diserete-time Yin] Diserete to wh 
o———s dixreie, ——— system ——-_—sF conn, 
cD a Hz} b pec 


Figure 5.22: Analog filter realization with a digital filter. 


For the sake of generality, we are assuming a noncausal system. The argument and the results are also valid for causal systems. The 
output y(t) of the system in Fig. 5.22b is 


aD 
y= | x(t)h,(t —t)dr 


“ 


= lim x. x(mAt)hg(t —mAr)At (5.69a) 


Ar--( 


For our purpose, it is convenient to use the notation T for 6 T in Eq. (5.69a). Assuming T (the sampling interval) to be small enough, 
such a change of notation yields 


<2] 
yaj=T oD x(mT )ha(t —mT) (5.69b) 


ma=- oo 


The response at the nth sampling instant is y(n7) obtained by setting tf = nT in the equation is 


oo 
y(nT) = T > x(mT)hal(n —_m)T] (5.69¢) 


In Fig. 5.22a, the input to H[z] is x(nT) = x[n]. If A[n] is the unit impulse response of H[z], then y[n], the output of H[z], is given by 


wo 


y[n] = ei x[mJh[n — m] (5.70) 


m——oo 


If the two systems are to be equivalent, y(n7T) in Eq. (5.69c) must be equal to y[n] in Eq. (5.70). Therefore 
h{n] = Th, (nT) (5.71) 


This is the time-domain criterion for equivalence of the two systems. !T] According to this criterion, h[n], the unit impulse response of 
H[z] in Fig. 5.22a, should be T times the samples of h,(t), the unit impulse response of the system in Fig. 5.22b. This is known as the 
impulse invariance criterion of filter design. 


Strictly speaking, this realization guarantees the output equivalence only at the sampling instants, that is, y(n7T) = y[n], and that also 
requires the assumption that T — 0. Clearly, this criterion leads to an approximate realization of Hz(s). However, it can be shown that 
when the frequency response of |H,(/w)| is bandlimited, the realization is exact,|2] provided the sampling rate is high enough to avoid 
any aliasing (T < 1/2f}). 


REALIZATION OF RATIONAL H(S) 
If we wish to realize an analog filter with transfer function 


H,(s) = (5.72a) 


s—A 


The impulse response h(t), given by the inverse Laplace transform of H,(s), is 


ha(t) = ce“ u(t) (5.72b) 


The corresponding digital filter unit impulse response A[n], per Eq. (5.71), is 


h[n] = Th,(nT) = Tce™* 


Figure 5.23 shows h,(t) and h[n] The corresponding H[z], the z-transform of h[n], as found from Table 5.1, is 


T cz 
Al[z] = Pa 


(5.73) 


i 


Figure 5.23: ieipulse response for analog mee digital systems in the impulse invariance method of filter design. 


The procedure of finding H[z] can be systematized for any Nth-order system. First we express an Nth-order analog transfer function 
H,(s) as a sum of partial fractions as!T] 


H,(s) =~ - “ (5.74) 


Then the corresponding H[z] is given by 
n 
Ciz 
HU] =T ) | —aF 
i=1 * 


This transfer function can be readily realized as explained in Section 5.4. Table 5.3 lists several pairs of H3(s) and their corresponding 
H[z]. For instance, to realize a digital integrator, we examine its Ha(s) = 1/s. From Table 5.3, corresponding to Ha(s) = 1/s (pair 2), we 
find H[z] = Tz/(z — 1). This is exactly the result we obtained in Example 3.7 using another approach. 


Note that Hz(jw) in Eq. (5.72a) [or (5.74)] is not bandlimited. Consequently, all these realizations are approximate. 


CHOOSING THE SAMPLING INTERVAL T 

The impulse invariance criterion (5.71) was derived under the assumption that T — 0. Such an assumption is neither practical nor 
necessary for satisfactory design. Avoiding of aliasing is the most important consideration for the choice of T. In Eq. (5.60a), we showed 
that for a sampling interval T seconds, the highest frequency that can be sampled without aliasing is 1/27 Hz or tt/T radians per 
second. This implies that Hz(jw), the frequency response of the analog filter in Fig. 5.22b should not have spectral components beyond 
frequency tt/T radians per second. In other words, to avoid aliasing, the frequency response of the system H,(s) must be bandlimited 
to T/T radians per second. We shall see later in Chapter 7 that frequency response of a realizable LTIC system cannot be bandlimited; 
that is, the response generally exists for all frequencies up to o. Therefore, it is impossible to digitally realize an LTIC system exactly 
without aliasing. The saving grace is that the frequency response of every realizable LTIC system decays with frequency. This allows 
for a compromise in digitally realizing an LTIC system with an acceptable level of aliasing. The smaller the value of T, the smaller the 
aliasing, and the better the approximation. Since it is impossible to make |H,(juw)| Zero, we are satisfied with making it negligible beyond 
the frequency Tr/T. As a rule of thumb,!°] we choose T such that |H,g(jw)| at the frequency w = Tt/T is less than a certain fraction 
(often taken as 1%) of the peak value of |H3(jw)|. This ensures that aliasing is negligible. The peak |H3(jw)| usually occurs at w = 0 
for lowpass filters and at the band center frequency w, for bandpass filters. 


Table 5.3: (Unilateral) z-Transform Pairs 
= Open table as spreadsheet 


No. |[ha(t) A[n] H[z] H,(s) 
K&(t) TK8[n] TK 


T*2z(z + 1) 
2(z — 1)3 


a] 
| 
— 


As+R 
s? + 2as +e 


Tre~*'cos(bt + @) Tre~2"T cos(bnT + 8) 


Trz[zcos @ — e~ cos (bT — 4)] 
z? — (2e-4T cos bT)z + e~4T 


A*c + B? — 2ABa Aa —B 
a b=VJc-a? @=tan-' | ——— 
c-a (~=—) 


EXAMPLE 5.16 


Design a digital filter to realize a first-order lowpass Butterworth filter with the transfer function 


H,(s) = ——* @, = 10° (5.75) 
S+0, 


For this filter, we find the corresponding H[z] according to Eq. (5.73)(or pair 5 in Table 5.3) as 


A(z] = ——> (5.76) 


Next, we select the value of 7 by means of the criterion according to which the gain at w =/T drops to 1% of the maximum filter gain. 
However, this choice results in such a good design that aliasing is imperceptible. The resulting amplitude response is so close to the 
desired response that we can hardly notice the aliasing effect in our plot. For the sake of demonstrating the aliasing effect, we shall 


deliberately select a 10% criterion (instead of 1%). We have 
W- 


fw ao w 


|H,(j@)| = 


In this case |H3(/W)|max = 1, which occurs at w = 0. Use of 10% criterion leads to |H,(tt/T)| = 0.1. Observe that 


soul O- 
|H,(j@)| = — o> o, 
a 
Hence, 
@, 
|Ho(x/T)|¥——=01 = > 2x/T =10e, = 105 
/T 
Thus, the 10% criterion yields T = 10-61. The 1% criterion would have given T= 107"tr. Substitution of T= 10~6rr in Eq. (5.76) yields 
0.3142z ” 
A(z] = -————_—— (5.77) 
z — 0.7304 
A canonical realization of this filter is shown in Fig. 5.24a. To find the frequency response of this digital filter, we rewrite H[z] as 
Al] = — > 
~~ 1 = 0.730427 
Therefore 
Hle*T) = 0.3142 = 0.3142 
~ 1=0.7304e-/°T ~ (1 — 0.7304c0s wT) + 70.7304 sin @T 
Consequently 
|H{e*"}| = 
2 
= Sa (5.78a) 
V1.533 — 1.4608 coswT 
0.7304 sinwT 
£H{e/*")} = —tan earn 5.78b 
led 1 — 0.7304 cosa ha 


Th) 0.3142 
fe: 


We v4 j yin} 
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{c) 
Figure 5.24: An example of filter design by the impulse invariance method: (a) filter realization, (b) amplitude response, and (c) 
phase response. 


This frequency response differs from the desired response H,(jw) because aliasing causes frequencies above tTt/T to appear as 
frequencies below tt/T. This generally results in increased gain for frequencies below tr/T. For instance, the realized filter gain at w=0 


is H[e!}=H[1]. This value, as obtained from Eq. (5.77), is 1.1654 instead of the desired value 1. We can partly compensate for this 
distortion by multiplying H[z] or H[e/”"] by a normalizing constant K=H,(0)/H[1] = 1/1.1654 = 0.858. This forces the resulting gain of 
Hel] to be equal to 1 at w = 0. The normalized H,[z] = 0.858H[z] = 0.858(0.111z/(z — 0.7304)). The amplitude response in Eq. 


(5.78a) is multiplied by K = 0.858 and plotted in Fig. 5.24b over the frequency range 0 < w < Tt/T= 10°. The multiplying constant K 
has no effect on the phase response in Eq. (5.78b), which is shown in Fig. 5.24c. 


Also, the desired frequency response, according to Eq. (5.75) with We. = 105, is 


WM. 10° 


H. ( ia) => = —_—_— 
ate jot+e@ jw+10 

Therefore 

|Ha(jw)| = LF and /H,(jw) = —tan™' ~ 
CONS Jee oe ae 10° 


This desired amplitude and phase response are plotted (dotted) in Fig. 5.24b and 5.24c for comparison with realized digital filter 
response. Observe that the amplitude response behavior of the analog and the digital filter is very close over the range W < W, = 10°. 


However, for higher frequencies, there is considerable aliasing, especially in the phase spectrum. Had we used the 1% rule, the 
realized frequency response would have been closer over another decade of the frequency range. 


COMPUTER EXAMPLE C5.3 
Using the MATLAB impinvar command, find the impulse invariance digital filter to realize the first-order analog Butterworth filter 
presented in Example 5.16. 


The analog filter transfer function is 10°/(s + 10°) and the sampling interval is T = 10-°r. 
>> num=[0 10*5]; den=[1 10%5]; 


>> T = pi/10*%6; Fs = 1/T; 
>> [b,a] = impinvar(num,den,Fs) ; 
>> tf(b,a,T) 


Transfer function: 
0.3142 z 


z - 0.7304 


Sampling time: 3.1416e-006 


EXERCISE E5.22 


Design a digital filter to realize an analog transfer a 
function ° 
20 

H,(s) = —— 

s+20 

Answers 
20Tz ™ 

A(z] = -——_— with 


~ 3000 


[tlBecause Tis a constant, some authors ignore the factor T, which yields a simplified criterion h[n]=h,(nT). Ignoring T merely scales 
the amplitude response of the resulting filter. 


[2]Qppenheim, A. V., and R. W. Schafer. Discrete-Time Signal Processing, 2nd ed. Prentice-Hall, Upper Saddle River, NJ, 1999. 


[T]lAssuming H,(s) has simple poles. For repeated poles, the form changes accordingly. Entry 6 in Table 5.3 is suitable for repeated 
poles. 


[3]Mitra, S. K. Digital Signal Processing, 2nd ed. McGraw-Hill, New York, 2001. 


5.8 CONNECTION BETWEEN THE LAPLACE TRANSFORM AND THE z-TRANSFORM 


We now show that discrete-time systems also can be analyzed by means of the Laplace transform. In fact, we shall see that the z- 
transform is the Laplace transform in disguise and that discretetime systems can be analyzed as if they were continuous-time systems. 


So far we have considered the discrete-time signal as a sequence of numbers and not as an electrical signal (voltage or current). 
Similarly, we considered a discrete-time system as a mechanism that processes a sequence of numbers (input) to yield another 
sequence of numbers (output). The system was built by using delays (along with adders and multipliers) that delay sequences of 
numbers. A digital computer is a perfect example: every signal is a sequence of numbers, and the processing involves delaying 
sequences of numbers (along with addition and multiplication). 


Now suppose we have a discrete-time system with transfer function H[z] and input x[n]. Consider a continuous-time signal x(t) such 


that its nth sample value is x[n], as shown in Fig. 5.25.lT] Let the sampled signal be x (t), consisting of impulses spaced T seconds 
apart with the nth impulse of strength x[n]. Thus 


w 
X(t) = }> x[a]s(t — nT) (5.79) 


n=O 


Figure 5.25 shows x[n] and the corresponding x (t). The signal x[n] is applied to the input of a discrete-time system with transfer 
function H[z], which is generally made up of delays, adders, and scalar multipliers. Hence, processing x[n] through H[z] amounts to 
operating on the sequence x[n] by means of delays, adders, and scalar multipliers. Suppose for x (f) samples, we perform operations 
identical to those performed on the samples of x[n] by H[z]. For this purpose, we need a continuous-time system with transfer function 
H(s) that is identical in structure to the discrete-time system H[z] except that the delays in H[z] are replaced by elements that delay 
continuous-time signals (such as voltages or currents). There is no other difference between realizations of H[z] and H(s). If a 
continuous-time impulse 6(f) is applied to such a delay of T seconds, the output will be 6(¢t — 7). The continuous-time transfer function 


of such a delay is a [see Eq. (4.46)]. Hence the delay elements with transfer function 1/z in the realization of H[z] will be replaced 
by the delay elements with transfer function eS! in the realization of the corresponding H(s). This is same as z being replaced by eS’. 
Therefore H(s)=H[eS"]. Let us now apply x[n] to the input of H[z] and apply x (ft) at the input of H{eS!]. Whatever operations are 


performed by the discrete-time system H[z] on x[n] (Fig. 5.25a) are also performed by the corresponding continuous-time system 
Hes] on the impulse sequence x (f) (Fig. 5.25b). The delaying of a sequence in H[z] would amount to delaying of an impulse train in 
H{e®"]. Adding and multiplying operations are the same in both cases. In other words, one-to-one correspondence of the two systems 
is preserved in every aspect. Therefore if y[n] is the output of the discrete-time system in Fig. 5.25a, then y (f), the output of the 
continuous-time system in Fig. 5.255, would be a sequence of impulse whose nth impulse strength is y[n]. Thus 


~ 


F(t) = >> yla}s(t — aT) (5.80) 


n=O 


o— 
Inf vin} ” a) 
> _—— i) 
yl un 


| a> i—> 


ow ih 


Figure 5.25: Connection between the Laplace transform and the z-transform. 


The system in Fig. 5.25b, being a continuous-time system, can be analyzed via the Laplace transform. If 
X(t) <=> X(s) and V(t) ——> ¥(s) 


then 

Y(s) = Hle™ |X(s) (5.81) 
Also 
X(s)=L Y= x[n]s(r —nT) 


n=0 


Now because the Laplace transform of §(t — nT) is e-8"7 


fee) 
X(s) = > x[nJe~"" (5.82) 
n=O 
and 
— a " 
Y(s)= bs y[nje™" (5.83) 
n=O 
Substitution of Eqs. (5.82) and (5.83) in Eq. (5.81) yields 
S- yinje™? = Hle™] | > xine” 
n—O n=—0 


By introducing a new variable z=e5! this equation can be expressed as 
o fo =] 


> yin" = H{z] >> xin} 


n=O n=) 


Y[z] = HIzIXIzl 


where ss ps 
X{z]= Doxtnie" = and YE] = Synz” 
n=O n=O 


It is clear from this discussion that the z-transform can be considered to be the Laplace transform with a change of variable z=eS! or 
s=(1/T) In z. Note that the transformation z=eS! transforms the imaginary axis in the s plane (s=/w) into a unit circle in the z plane 
(z=eS!=eiWT or |z|=1) The LHP and RHP in the s plane map into the inside and the outside, respectively, of the unit circle in the z 
plane. 


[tlWe can construct such x(t) from the sample values, as explained in Chapter 8. 


5.9 THE BILATERAL z-TRANSFORM 


Situations involving noncausal signals or systems cannot be handled by the (unilateral) z-transform discussed so far. Such cases can 
be analyzed by the bilateral (or two-sided) z-transform defined in Eq. (5.1), as 
ie) 


X[z] = s- x[a]z" 


a=—OO 


As in Eq. (5.2), the inverse z-transform is given by 


1 
x[n] = aa f Mel” ‘dz 
2x j 


These equations define the bilateral z-transform. Earlier, we showed that 


y*ulnl — —— sel > II (5.84) 
In contrast, the z-transform of the signal — y” u[—(n + 1)], illustrated in Fig. 5.26a, is 
=I -I n 
Z{-y"u[—-(2+)D)} = )>_-y*z" = -(%) 
—oo —oo « 
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Figure 5.26: (a) —y"u[ —(n + 1)] and (b) the region of convergence (ROC) of its z-transform. 


Therefore 


2({-y"u[—(2 + 1))) = ar lz| < lvl (5.85) 


~ 


A comparison of Eqs. (5.84) and (5.85) shows that the z-transform of y”u[n] is identical to that of —y”u[—(n + 1)]. The regions of 
convergence, however, are different. In the former case, X[z] converges for |z| > |y|;in the latter, X[z] converges for |z| < |y|(see Fig. 
5.26b). Clearly, the inverse transform of X[z] is not unique unless the region of convergence is specified. If we add the restriction that 


all our signals be causal, however, this ambiguity does not arise. The inverse transform of z/(z — y) is y"u[n] even without specifying 
the ROC. Thus, in the unilateral transform, we can ignore the ROC in determining the inverse z-transform of X[z]. 


As in the case the bilateral Laplace transform, if x[nJ=r*j-4 xj[n], then the ROC for X{[z] is the intersection of the ROCs (region 
common to all ROCs) for the transforms X4[z], X2[Z],....X4{[Z]. 


The preceding results lead to the conclusion (similar to that for the Laplace transform) that if z=B is the largest magnitude pole for a 
causal sequence, its ROC is |z| > |B]. If z=c is the smallest magnitude nonzero pole for an anticausal sequence, its ROC is |z| < ||. 


REGION OF CONVERGENCE FOR LEFT-SIDED AND RIGHT-SIDED SEQUENCES 
Let us first consider a finite duration sequence x;[n], defined as a sequence that is nonzero for Ny < n < No, where both Ny and No 


are finite numbers and No > N,. Also 
N; 


Xslzl= >> x,[n}z" 


n=N1 


For example, if Ny=—2 and No=1, then 


x,{1] 


- 
“ 


X plz] = xpl—2]z? + xpl—1]z + x10] + 


Assuming all the elements in x;[n] are finite, we observe that X;[z] has two poles at z=oo because of terms xq—2]z? + xq—1]z and one 
pole at z=0 because of term x,{1]/z. Thus, a finite duration sequence could have poles at z=0 and z=co. Observe that X;[z] converges 
for all values of z except possibly z=0 and z = o. 


This means that the ROC of a general signal x[n] + x;[n] is the same as the ROC of x[n] with the possible exception of z=0 and z=oo. 


A right-sided sequence is zero for n < No < © and a left-sided sequence is zero for n > Ny > — «~. A causal sequence is always a 
right-sided sequence, but the converse is not necessarily true. An anticausal sequence is always a left-sided sequence, but the 
converse is not necessarily true. A two-sided sequence is of infinite duration and is neither right sided nor left sided. 


A right-sided sequence x,[n] can be expressed as x,[n]=x,[n] + x;[n], where x,[n] is a causal signal and x; [n] is a finite duration signal. 
Therefore, the ROC for x,[n] is the same as the ROC for x,[n] except possibly z=oo. If z=B is the largest magnitude pole for a right- 
sided sequence x,[n], its ROC is |B] < |z| < ©. Similarly, a left-sided sequence can be expressed as x4[n]=x,[n] + x;[n], where x,[n] 
is an anticausal sequence and x,{n] is a finite duration signal. Therefore, the ROC for x;[n] is the same as the ROC for x,[n] except 
possibly z=0. Thus, if z= is the smallest magnitude nonzero pole for a left-sided sequence, its ROC is 0 < |z| <|a|. 


EXAMPLE 5.17 
Determine the z-transform of 


x[a] = (0.9)"ufn] + (1.2)"u[—(n + 1)] 


= X,[n| + x21n] 
From the results in Eqs. (5.84) and (5.85), we have 
Xilz] =———__ [z| > 0.9 
z—0.9 | 
X2[z] =——= fal < 122 


~ + 


The common region where both X4[z] and X2[z] converge is 0.9 < |z| < 1.2 (Fig. 5.27b). 


il Ne : 


a 
Figure 5.27: (a) Signal x[n] and (b) ROC of X{z]. 
Hence 
X[z] = X,[z] + X2[z] 
“2-09 z—-12 
— is opeRe (5.86) 


(z — 0.9)(z — 1.2) 
The sequence x[n] and the ROC of X[z] are depicted in Fig. 5.27. 


EXAMPLE 5.18 
Find the inverse See of 
—2(z + 0.4 
X{z] = —__| 
Iz] (z — 0.8)(z — 2) 
if the ROC is 
a. |z| >2 
b. |z| < 0.8 
c. 0.8 <|z| <2 
(a) 
X{z]_— —(z + 0.4) 
z (z — 0.8)(z — 2) 
1 2 
~ g—08 2-2 
and és . 
X[z] = —2 
[=] z—0.8 z—2 


Since the ROC is |z| > 2, both terms correspond to causal sequences and 


x[n] = [(0.8)" — 2(2)"]uln] 


This sequence appears in Fig. 5.28a. 
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Figure 5.28: Three possible inverse transforms of X{[z]. 


(b) In this case, |z| < 0.8, which is less than the magnitudes of both poles. Hence, both terms correspond to anticausal sequences, and 


x[n] = [—(0.8)" + 2(2)"]u[—(n + D)] 
This sequence appears in Fig. 5.28b. 


(c) In this case, 0.8 < |z| < 2; the part of X[z] corresponding to the pole at 0.8 is a causal sequence, and the part corresponding to the 
pole at 2 is an anticausal sequence: 


x[n] = (0.8)"u[n] + 2(2)"ul—(n + 1)] 


This sequence appears in Fig. 5.28c. 
EXERCISE E5.23 


Find the inverse z-transform of 9 


£2) = 7 
e+ zti 


Answers 


6(—4)"uln) + 6(—L)"ul-a +) 


INVERSE TRANSFORM BY EXPANSION OF X{Z] INPOWER SERIES OF Z 


We have 


X[z]= >> xine" 


For an anticausal sequence, which exists only for n < —1, this equation becomes 

X[z] = xf[-1lz + x[-2lz? + x1-3lz* +--: 

We can find the inverse z-transform of X[z] by dividing the numerator polynomial by the denominator polynomial, both in ascending 
powers of z, to obtain a polynomial in ascending powers of z. Thus, to find the inverse transform of z/(z — 0.5) (when the ROC is |z| < 
0.5), we divide z by —0.5 + z to obtain —2z - 4z? - 8z° - ... Hence, x[-1]=—2, x[—2]=—4, x[—3]=—8, and so on. 


5.9-1 Properties of the Bilateral z-Transform 


Properties of the bilateral z-transform are similar to those of the unilateral transform. We shall merely state the properties here, without 
proofs, for xj[n] <=> X;[z] 


LINEARITY 
ay X;[n] + doxoIn] — > a, Xi[z] + a2X2[z) 


The ROC for a4X4[z] + a2Xo[z] is the region common to (intersection of) the ROCs for X4[z] and X9[z] 


SHIFT 


1 ; 
x[n —m|] — mid [z] m is positive or negative integer 


The ROC for X[z]/z'” is the ROC for X[z] (except for the addition or deletion of z=0 or z=oo caused by the factor 1/z. 


CONVOLUTION 
Xiln] * xo[n] — > X,[z]X-Iz1 


The ROC for X4[z]X2[z] is the region common to (intersection of) the ROCs for X4[z] and X9[z]. 
MULTIPLICATION BY y” 
y"x[n] —> X = 
Y¥ 
If the ROC for X{z] is |y4| < |z| < |y2|, then the ROC for X[z/y] is |yy1| < [Z| < |yy2|, indicating that the ROC is scaled by the factor |y]. 


MULTIPLICATION BY n 


nx[nju[n|] <= --4 X{z] 


The ROC for —z(dX/dz) is the same as the ROC for X[z]. 


TIME REVERSAL! 
x[—n] ==> XT1/z] 


If the ROC for X{[zlis ly| < |z| < lyl2| then the ROC for X[1/z] is 1/y4 > |z| > |1/y2| 


5.9-2 Using the Bilateral z-Transform for Analysis of LTID Systems 


Because the bilateral z-transform can handle noncausal signals, we can use this transform to analyze noncausal linear systems. The 
zero-state response y[n] is given by 


y[n] = 27'{X[z]H[z}} 


provided X[z]H[z] exists. The ROC of X[z]H[z] is the region in which both X[z] and H[z] exist, which means that the region is the 
common part of the ROC of both X[z] and H[z]. 


EXAMPLE 5.19 
For a causal system specified by the transfer function 
7 

iz) = 2 a= 

z-0.5 
find the zero-state response to input 
x[n] = (0.8)"u[n] + 2(2)"u[—(n + 1)] 
XIz] z 2z —z(z + 0.4) 

“2-08 2-2 (z-—0.8)(z—-2) 

The ROC corresponding to the causal term is |z| > 0.8, and that corresponding to the anticausal term is |z| < 2. Hence, the ROC for 
X{z] is the common region, given by 0.8 < |z| < 2. Hence 


—z(z + 0.4) 
X{z] = —————_—__ 0.8 < |z 2 
[l= C-0G—D - 


Therefore 


Y[z] = X[z]A[z] = 


—z°(z + 0.4) 
(z — 0.5)(z — 0.8)(z — 2) 
Since the system is causal, the ROC of H[z] is |z| > 0.5. The ROC of X[z] is 0.8 < |z| < 2. 


The common region of convergence for X[z] and H[z] is 0.8 < |z| < 2. Therefore 
Iz] —27(z + 0.4) ell aol 
2] = 8 < |[2| < 
(z — 0.5)(z — 0.8)(z — 2) 


Expanding Y[z] into modified partial fractions yields 


z 8 z 8 z 
rial =-— +3 (—5)-3 (5) 0.8 < |z| <2 


Since the ROC extends outward from the pole at 0.8, both poles at 0.5 and 0.8 correspond to causal sequence. The ROC extends in 
ward from the pole at 2. Hence, the pole at 2 corresponds to anticausal sequence. Therefore 


yln] = [-(0.5)" + §(0.8)"] ula] + §(2)"ul-(™ + 1)) 


EXAMPLE 5.20 


For the system in Example 5.19, find the zero-state response to input 


x[n] = (0.8)"u[n] + (0.6)"u[—(m + 1)] 
“i [nm] xs[n] 


The z- puaae ume of the causal and anticausal components x4[n] and xg[n] of the output are 


X\[z] = |z| > 0.8 


08 


Xz] = lz| < 0.6 

_—_ 
Observe that a common ROC for X4[z] and Xz[z] does not exist. Therefore X[z] does not exist. In such a case we take advantage of 
the superposition principle and find y;[n] and y2[n], the system responses to x,[n] and x2[n], separately. The desired response y[n] is 
the sum of Zi [n] and y2[n]. Now 


H[z = lz] > 0.5 


05 


¥i[z] = Xz) Az] = (05) —08) \z| > 0.8 


Y,[z] = X2[z]A[z] = 0.5 < |z| < 0.6 


(z — 0.5)(z — 0.6) 
Expanding Y4[z] and Y2[z] into modified partial fractions yields 


5 z 8 z 
Y,[z] = “3 (5) + 3 (=) iz| > 0.8 


Halal = 5 (~ +5)- s(—..) 0.5 < |z| < 0.6 


Therefore 


vila] = [—$(0.5)" + $(0.8)"] un] 


ya[n] = 5(0.5)"u[n] + 6(0.6)"ul—(n + 1)] 


and 


y[a] = yi [a] + yofn] 
= [2(0.5)" + $(0.8)"]uln] + 6(0.6)"u[—(n + 1)] 


EXERCISE E5.24 


For a causal cS Aas in Example 5.19, find the zero-state response to input 2 


x(n] = (+)" u[n] + 53)"u[-(@ + 1] 


Answers 


[—(+)" + 3(4)" ula] + 6)"u[-(a + 1)] 


[tFor complex signal x[n], the property is modified, as follows: 


x*[—n] <=> X°[1/z'] 


5.10 SUMMARY 


In this chapter we discussed the analysis of linear, time-invariant, discrete-time (LTID) systems by means of the z-transform. The z- 
transform changes the difference equations of LTID systems into algebraic equations. Therefore, solving these difference equations 
reduces to solving algebraic equations. 


The transfer function H[z] of an LTID system is equal to the ratio of the z-transform of the output to the z-transform of the input when 
all initial conditions are zero. Therefore, if X[z] is the z-transform of the input x[n] and Y[z] is the z-transform of the corresponding 
output y[n] (when all initial conditions are zero), then Y[z]=H[z]X[z]. For an LTID system specified by the difference equation 
Q[E]y[n]=P[E]x[n], the transfer function H[z]=P[z]/Q[z]. Moreover, H[z] is the z-transform of the system impulse response h[n]. We 


showed in Chapter 3 that the system response to an everlasting exponential z” is H[z]z”. 


We may also view the z-transform as a tool that expresses a signal x[n] as a sum of exponentials of the form z” over a continuum of 
the values of z. Using the fact that an LTID system response to z” is H[z]z", we find the system response to x[n] as a sum of the 
system's responses to all the components of the form z” over the continuum of values of z. 


LTID systems can be realized by scalar multipliers, adders, and time delays. A given transfer function can be synthesized in many 
different ways. We discussed canonical, transposed canonical, cascade, and parallel forms of realization. The realization procedure is 
identical to that for continuous-time systems with 1/s (integrator) replaced by 1/z (unit delay). 


In Section 5.8, we showed that discrete-time systems can be analyzed by the Laplace transform as if they were continuous-time 
systems. In fact, we showed that the z-transform is the Laplace transform with a change in variable. 


The majority of the input signals and practical systems are causal. Consequently, we are required to deal with causal signals most of 
the time. Restricting all signals to the causal type greatly simplifies z-transform analysis; the ROC of a signal becomes irrelevant to the 
analysis process. This special case of z-transform (which is restricted to causal signals) is called the unilateral z-transform. Much of the 
chapter deals with this transform. Section 5.9 discusses the general variety of the z-transform (bilateral z-transform), which can handle 
causal and noncausal signals and systems. In the bilateral transform, the inverse transform of X[z] is not unique, but depends on the 
ROC of X[z]. Thus, the ROC plays a crucial role in the bilateral z-transform. 
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MATLAB SESSION 5: DISCRETE-TIME IIR FILTERS 


Recent technological advancements have dramatically increased the popularity of discrete-time filters. Unlike their continuous-time 
counterparts, the performance of discrete-time filters is not affected by component variations, temperature, humidity, or age. 
Furthermore, digital hardware is easily reprogrammed, which allows convenient change of device function. For example, certain digital 
hearing aids are individually programmed to match the required response of a user. 


Typically, discrete-time filters are categorized as infinite-impulse response (IIR) or finiteimpulse response (FIR). A popular method to 
obtain a discrete-time IIR filter is by transformation of a corresponding continuous-time filter design. MATLAB greatly assists this 
process. Although discrete-time IIR filter design is the emphasis of this session, methods for discrete-time FIR filter design are 
considered in MATLAB Session 9. 


M5.1 Frequency Response and Pole-Zero Plots 

Frequency response and pole-zero plots help characterize filter behavior. Similar to continuoustime systems, rational transfer functions 
for realizable LTID systems are represented in the z-domain as 
Viz] _ Bla) _ Creole * _ Ceeohz* 

X(z] Alz]  Shoaz™ 
When only the first (N14 + 1) numerator coefficients are nonzero and only the first (N2 + 1) denominator coefficients are nonzero, Eq. 
(M5.1) simplifies to 


H{z] = (MS5.1) 
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The form of Eq. (M5.2) has many advantages. It can be more efficient than Eq. (M5.1); it still works when N4=N2=N; and it more closely 
conforms to the notation of built-in MATLAB discrete-time signal processing functions. 


The right-hand side of Eq. (M5.2) is a form that is convenient for MATLAB computations. The frequency response H(e!2) is obtained by 


letting z=e/2, where Q. has units of radians. Often, Q=wT, where w is the continuous-time frequency in radians per second and T is 
the sampling period in seconds. Defining length-(N2 + 1) coefficient vector A=[ao, a4,...,@y2] and length-(N4 + 1) coefficient vector 


B=[bo, 64,..., Dyy7], program MS 5P1 computes H(e!2) by using Eq. (M5.2) for each frequency in the input vector Q. 


function [H]=MS5P1 (B,A,Omega) ; 
MS5P1.m : MATLAB Session 5, Program 1 
Function M-file computes frequency response for LTID systems 
INPUTS: B=vector of feedforward coefficients 
A=vector of feedback coefficients 
Omega=vector of frequencies [rad], typically - pi<=Omega>=pi 
OUTPUTS: H=frequency respons 
1=length(B)-1; N 2=length(A)-1; 
H=polyval (B, exp (j*Omega) )./polyval (A, exp (j*Omega) ) .*exp(j*Omega* (N 2-N 1)); 


dP lO lO ol ol? lO 


Note that owing to MATLAB's indexing scheme, A(k) corresponds to coefficient ay,_; and B(k) corresponds to coefficient by_7. It is 
also possible to use the signal processing toolbox function freqz to evaluate the frequency response of a system described by Eq. 
(M5.2). Under special circumstances, the control system toolbox function bode can also be used. 


Program MS5P2 computes and plots the poles and zeros of an LTID system described by Eq. (M5.2) again using vectors B and A. 


function [p,z]=MS5P2(B,A); 

MS5P2.m : MATLAB Session 5, Program 2 

Function M-file computes and plots poles and zeros for LTID systems 

INPUTS: B=vector of feedforward coefficients 

A=vector of feedback coefficients 

1=length(B)-1; N 2=length(A)-1; 
p=roots ([A, zeros (1,N_1-N 2)]); z=roots([B, zeros(1,N_2-N 1)]); 
ucirc=exp (j*linspace(0,2*pi,200)); % Compute unit circle for pole-zero plot 
plot(real(p),imag(p), 'xk',real (z),imag(z), ‘ok',real(ucirce), imag(ucirc),'k:"'); 
xlabel('Real'); ylabel('Imaginary' 
ax=axis; dx=0.05* (ax(2)-ax(1)); dy 
axis (ax+[-dx,dx,-dy,dy]); 


dP oP dO dle 


i 
i 
=0.05% (ax(4)-ax (3)); 


The right-hand side of Eq. (M5.2) helps explain how the roots are computed. When N41 +# No, the term z Ng implies additional roots 
at the origin. If N4 > No, the roots are poles, which are added by concatenating A with zeros (N_1-N_2, 1); since No — No Ny < 
0, zeros (N_2-N_1,1) produces the empty set and B is unchanged. If No > N41, the roots are zeros, which are added by 

concatenating B with zeros (N_2-N_1,1); since Nj — No < 0, zeros (N_1-N_2,1) produces the empty set and A is unchanged. 


Poles and zeros are indicated with black x's and o's, respectively. For visual reference, the unit circle is also plotted. The last line in 
MS5P2 expands the plot axis box so that root locations are not obscured. 


M5.2 Transformation Basics 


Transformation of a continuous-time filter to a discrete-time filter begins with the desired continuous-time transfer function 


H(s) = Y(s) - B(s) - oe bees 
X(s) — A(s) yy aes’ -* 


As a matter of convenience, H(s) is represented in factored form as 
M 
by_m T]p_1(8 — 2) 
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where Zz, and px are the system poles and zeros, respectively. 


A(s) = (M5.3) 


A mapping rule converts the rational function H(s) to a rational function H/z/. Requiring that the result be rational ensures that the 
system realization can proceed with only delay, sum, and multiplier blocks. There are many possible mapping rules. For obvious 
reasons, good transformations tend to map the w axis to the unit circle, w=0 to z=1, wW=oo to z=—1, and the left half-plane to the 
interior of the unit circle. Put another way, sinusoids map to sinusoids, zero frequency maps to zero frequency, high frequency maps to 
high frequency, and stable systems map to stable systems. 


Section 5.8 suggests that the z-transform can be considered to be a Laplace transform with a change of variable z=e®! or s=(1/T) In z, 
where T is the sampling interval. It is tempting, therefore, to convert a continuous-time filter to a discrete-time filter by substituting 


s=(1/T) In z into H(s), or H/ZJ=H(s)|s=1/T)in z- Unfortunately, this approach is impractical since the resulting H/zj is not rational and 
therefore cannot be implemented by using standard blocks. Although not considered here, the so-called matched-z transformation relies 
on the relationship z=e5! to transform system poles and zeros, so the connection is not completely without merit. 


M5.3 Transformation by First-Order Backward Difference 


Consider the transfer function H(s)= Y(s)/X(s)=s, which corresponds to the first-order continuous-time differentiator 


(= q x(t) 
a ae 


An approximation that resembles the fundamental theorem of calculus is the first-order backward difference 
(1) x(t) —x(@t -—T) 
y= —— 
: f 
For sampling interval T and f=nT, the corresponding discrete-time approximation is 
x[n] — x[n — 1] 
i 
which has transfer function 


l 
A(z] = ¥[2l/X{z] = —.— 


y[n] = 


This implies a transformation rule that uses the change of variable s=(1 — Zz VT or z=1/(1 — sT). This transformation rule is appealing 
since the resulting H/z] is rational and has the same number of poles and zeros as H(s). Section 3.4 discusses this transformation 
strategy in a different way in describing the kinship of difference equations to differential equations. 


After some algebra, substituting s=(1 — z_')/T into Eq. (M5.3) yields 
M = 

Hil = (2 1, a/7 = T= (1 <a oe ') 

ao []eu1(1/T — pe) Mts (1- ez") 


The discrete-time system has M zeros at 1/(1 — Tz,) and N poles at 1/(1 — Tp x). This transformation rule preserves system stability 
but does not map the w axis to the unit circle (see Prob. 5.7-9). 


(MS.4) 


MATLAB program MS5P3 uses the first-order backward difference method of Eq. (M5.4) to convert a continuous-time filter described by 
coefficient vectors A=[ao, a4,...,aq] and B=[by.yy, by-M+4,...,0,] into a discrete-time filter. The form of the discrete-time filter follows 
Eq. (M5.2). 


function [Bd,Ad]=MS5P3(B,A,T); 

MS5P3.m : MATLAB Session 5, Program 3 

Function M-file first-order backward difference transformation 

of a continuous-time filter described by B and A into a discrete-time filter. 

INPUTS: B=vector of continuous-time filter feedforward coefficients 
A=vector of continuous-time filter feedback coefficients 
T=sampling interval 

OUTPUTS: Bd=vector of discrete-time filter feedforward coefficients 
Ad=vector of discrete-time filter feedback coefficients 

z=roots(B); p=roots(A); % s-domain roots 

gain=B (1) /A(1) *prod(1/T-z) /prod(1/T-p) ; 

zd=1./(1-T*z); pd=1./(1-T*p); % z-domain roots 

Bd=gain* poly (zd); Ad=poly (pd) ; 
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M5.4 Bilinear Transformation 


The Bilinear transformation is based on a better approximation than first-order backward differences. Again, consider the continuous- 
time integrator 


({t)= § x(t) 
os oe 
Represent signal x(t) as 


! 

a 

xi) = | —x(t)dt+x(t—T) 
t r dt 


Letting t=nT and replacing the integral with a trapezoidal approximation yields 


LT td d 
x(aT) = — |—x(nT) + —x(aT — r)| +x(nT —T) 
2 : dt 


Substituting y(t) for (d/dt)x(t), the equivalent discrete-time system is 
x[a] = = (ytn] + y[a — 1]) + x[n — 1] 

From z-transforms, the transfer function is 

Hz — 7H 2(l = o) 

X[z]  T(l+z-") 


The implied change of variable s=2(1 — zy + z') or z=(1 + sT/2)/(1 — sT/2) is called the bilinear transformation. Not only does 
the bilinear transformation result in a rational function H/zj, the w-axis is correctly mapped to the unit circle (see Prob. 5.6-11a). 


After some algebra, substituting s=2(1 — zy + Ze." into Eq. (M5.3) yields 


Mt +2T/2 
on (ts Mer =) Ti, (1 - Pee) 


“ N ? 1amThe 
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In addition to the M zeros at (1 + z,T/2)/(1 — z,T/2) and N poles at (1 + p,T/2)/(1 — p,T/2), there are N — M zeros at minus one. Since 
practical continuous-time filters require M < N for stability, the number of added zeros is thankfully always nonnegative. 


MATLAB program MS5P4 converts a continuous-time filter described by coefficient vectors A=[ag, a4,...,aq] and B=[byyOn-met,--. On] 
into a discrete-time filter by using the bilinear transformation of Eq. (M5.5). The form of the discrete-time filter follows Eq. (M5.2). If 
available, it is also possible use the signal processing toolbox function bilinear to perform the bilinear transformation. 


function [Bd,Ad]=MS5P4 (B,A,T); 

MS5P4.m : MATLAB Session 5, Program 4 

Function M-file bilinear transformation of a continuous-time filter 

described by vectors B and A into a discrete-time filter. 

Length of B must not exceed A. 

INPUTS: B=vector of continuous-time filter feedforward coefficients 
A=vector of continuous-time filter feedback coefficients 
T=sampling interval 

OUTPUTS: Bd=vector of discrete-time filter feedforward coefficients 
Ad=vector of discrete-time filter feedback coefficients 

if (length(B) > length(A)), 

disp ('Numerator order must not exceed denominator order.); 

return 

end 

z=roots(B); p=roots(A); % s-domain roots 

gain=real (B(1)/A(1)*prod(2/T-z)/prod(2/T-p)); 

zd=(1+z*T/2) ./(1-z*T/2); pd=(1+p*T/2) ./(1-p*T/2); % z-domain roots 

Bd=gain*poly([zd;-ones (length (A) -length(B),1)]); Ad=poly(pd) ; 
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As with most high-level languages, MATLAB supports general if-structures: 


if expression, 
statements; 

elseif expression, 
statements; 

else, 

statements; 

end 


In this program, the if statement tests M > N. When true, an error message is displayed and the return command terminates 
program execution to prevent errors. 


M5.5 Bilinear Transformation with Prewarping 


The bilinear transformation maps the entire infinite-length w axis onto the finite-length unit circle (z=e!®) according to w=(2/T) tan 
(O/2) (see Prob. 5.6-11b). Equivalently, Q=2 arctan (vw 7/2). The nonlinearity of the tangent function causes a frequency compression, 
commonly called frequency warping, that distorts the transformation. 


To illustrate the warping effect, consider the bilinear transformation of a continuous-time lowpass filter with cutoff frequency w.=2TT3000 
rad/s. If the target digital system uses a sampling rate of 10kHz, then T=1/(10,000) and w, maps to 0,=2 arctan (W,7/2)=1.5116. 
Thus, the transformed cutoff frequency is short of the desired O,=w,7=0.611=1.8850. 


Cutoff frequencies are important and need to be as accurate as possible. By adjusting the parameter T used in the bilinear transform, 
one continuous-time frequency can be exactly mapped to one discrete-time frequency; the process is called prewarping. Continuing the 


last example, adjusting T=(2/w,) tan (0/2) = 1/6848 achieves the appropriate prewarping to ensure W,=2Tt3000 maps to 0,=0.6TT. 


M5.6 Example: Butterworth Filter Transformation 


To illustrate the transformation techniques, consider a continuous-time 10th-order Butterworth lowpass filter with cutoff frequency 
W,=2713000, as designed in MATLAB Session 4. First, we determine continuous-time coefficient vectors A and B. 


>> omega.c=2*pi*3000; N=10; 

>> poles=roots([(j*omega.c)*(-2*N), zeros(1,2*N-1),1]); 
>> poles=poles (find(poles<0)); 

>> B=1; A=poly(poles); A=A/A(end) ; 


Programs MS5P3 and MS5P4 are used to perform first-order forward difference and bilinear transformations, respectively. 


>> Omega=linspace(0,pi,200); T=1/10000; Omega.c=omega=c*T; 

>> [Bl1,A1]=MS5P3(B,A,T); % First-order backward difference transformation 

>> [B2,A2]=MS5P4(B,A,T); % Bilinear transformation 

>> [B3,A3]=MS5P4 (B,A,2/omega=c*tan (Omega=c/2)) ; % Bilinear with prewarping 


Magnitude responses are computed by using MS5P1 and then plotted. 


>> Hlmag=abs (MS5P1(B1,A1,Omega) ); 
>> H2mag=abs (MS5P1 (B2,A2, Omega) 
>> H3mag=abs (MS5P1 (B3,A3, Omega) 


) 

) 

' Ud 
Omega, H2mag, 'k--',Omega,H3mag,'k:'); 


>> plot (Omega, (Omega<=Omega c), k! Omega,Hlmag,'k-.',... 
' . 

>> axis([0 pi -.05 1.5]); 

>> xlabel('/Omega [rad]'); ylabel('Magnitude Response'); 

>> legend('Ideal','First-Order Backward Difference',... 

"Bilinear','Bilinear with Prewarping'); 


The result of each transformation method is shown in Fig. M5.1. 
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Figure M5.1: Comparison of various transformation techniques. 


Although the first-order backward difference results in a lowpass filter, the method causes significant distortion that makes the resulting 
filter unacceptable with regard to cutoff frequency. The bilinear transformation is better, but, as predicted, the cutoff frequency falls short 


of the desired value. Bilinear transformation with prewarping properly locates the cutoff frequency and produces a very acceptable filter 
response. 


M5.7 Problems Finding Polynomial Roots 


Numerically, it is difficult to accurately determine the roots of a polynomial. Consider, for example, a simple polynomial that has a root at 
minus one repeated four times, (s + 1)*=8* + 45° + 6s? + 4s + 1. The MATLAB roots command returns a surprising result: 


>> roots ([1 4 6 4 1)]) 
ans= -1.0002 -1.0000 -0.0002i1 -1.0000 + 0.00021 -0.9998 


Even for this low-degree polynomial, MATLAB does not return the true roots. 


The problem worsens as polynomial degree increases. The bilinear transformation of the 10th-order Butterworth filter, for example, 
should have 10 zeros at minus one. Figure M5.2 shows that the zeros, computed by MS5P2 with the roots command, are not correctly 
located. 


Imaginary 


Real 
Figure M5.2: Pole-zero plot computed by using roots. 


When possible, programs should avoid root computations that may limit accuracy. For example, results from the transformation 
programs MS5P3 and MS5P4 are more accurate if the true transfer function poles and zeros are passed directly as inputs rather than 
the polynomial coefficient vectors. When roots must be computed, result accuracy should always be verified. 


M5.8 Using Cascaded Second-Order Sections to Improve Design 


The dynamic range of high-degree polynomial coefficients is often large. Adding the difficulties associated with factoring a high-degree 
polynomial, it is little surprise that high-order designs are difficult. 


As with continuous-time filters, performance is improved by using a cascade of second-order sections to design and realize a discrete- 
time filter. Cascades of second-order sections are also more robust to the coefficient quantization that occurs when discrete-time filters 
are implemented on fixed-point digital hardware. 


To illustrate the performance possible with a cascade of second-order sections, consider a 180th-order transformed Butterworth 
discrete-time filter with cutoff frequency 0,=0.6 1 = 1.8850. Program MS5P5 completes this design, taking care to initially locate poles 
and zeros without root computations. 


% MS5SP5.m : MATLAB Session 5, Program 5 

% Script M-file designs a 180th-order Butterworth lowpass discrete-time filter 
% with cutoff Omega.c=0.6*pi using 90 cascaded second-order filter sections. 
omega 0=1; % Use normalized cutoff frequency for analog prototype 
psi=[0.5:1:90]*pi/180; % Butterworth pole angles 

Omega.c=0.6*pi; % Discrete-time cutoff frequency 


Omega=linspace(0,pi,1000); % Frequency range for magnitude response 
Hmag=zeros (90,1000); p=zeros(1,180); z=zeros(1,180); % Pre-allocation 

for stage=1:90, 

Q=1/(2*cos (psi (stage))); % Compute Q for stage 

B = omega 0*2; A=[1 omega 0/Q omega 0*2]; % Compute stage coefficients 
[B1,A1]=MS5P4 (B,A, 2/omega O*tan(0.6*pi/2)); % Transform stage to DT 
p(stage*2-1:stage*2)=roots (Al); % Compute z-domain poles for stage 
z(stage*2-l1:stage*2)=roots(Bl); % Compute z-domain zeros for stage 

Hmag (stage, :)=abs (MS5P1(B1,Al1,Omega)); % Compute stage mag response 

end 

ucirc=exp (j*linspace(0,2*pi,200)); % Compute unit circle for pole-zero plot 
figure; 

plot (real(p),imag(p),'kx',real(z),imag(z),'ok',real(ucirc),imag(ucirce), 'k:'); 
axis equal; xlabel('Real'); ylabel('Imaginary'); 

figure; plot (Omega,Hmag,'k'); axis tight 

xlabel('\Omega [rad]'); ylabel('Magnitude Response'); 

figure; plot (Omega,prod(Hmag),'k'); axis([0 pi -0.05 1.05]); 

xlabel('\Omega [rad]'); ylabel('Magnitude Response'); 


The figure command preceding each plot command opens a separate window for each plot. 


The filter's pole-zero plot is shown in Fig. M5.3, along with the unit circle, for reference. All 180 zeros of the cascaded design are 
properly located at minus one. The wall of poles provides an amazing approximation to the desired brick-wall response, as shown by 
the magnitude response in Fig. M5.4. It is virtually impossible to realize such high-order designs with continuous-time filters, which adds 
another reason for the popularity of discrete-time filters. Still, the design is not trivial; even functions from the MATLAB signal 
processing toolbox fail to properly design such a high-order discrete-time Butterworth filter! 
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Figure M5.3: Pole-zero plot for 180th-order discrete-time Butterworth filter. 
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Figure M5.4: Magnitude response for a 180th-order discrete-time Butterworth filter. 


PROBLEMS 


9.1.1 Using the definition, compute the z-transform of x[n] = (—1)"(u[n] — u[n — 8]). Sketch the poles and zeros of X(z) in the 
z plane. No calculator is needed to do this problem! 


5.1.2 Using the definition of the z-transform, find the z-transform and the ROC for each of the following signals. 
a. u[n — m] 
b. y"sin Tr nu[n] 


c. y"cos Tr nu[n] 


_ aN 
y" sin 7a u[n] 


d. 
mm 

y" cos — u[n] 
e. 2 

oo 

a 8[n — 2k] 
f. e=0 
gy" ufn—1] 


h. ny"u[n] 


nu[n] 
Y u(r] 
n!\ 


. (21 — (= 2)" ufn] 


(In @)” 


n!\ 


u[n] 


5.1.3 Showing all work, evaluate =°,=-9 n(3/2)-” 


5.1.4 Using only the z-transforms of Table 5.1, determine the z-transform of each of the following signals. 


a. 
b. 


c. 


. jae cos (Fn) ]uta - 1] 


ny" un — 1] 


h. 


u[n] — u[n — 2] 
y2 u[n—-2] 


21 un — 1] + e™1u[n] 


. n(n — 1)(n — 2) 2" “Sun — m] for m = 0,1,2,3 


. (= 1) nun] 


Ow 
So k5(n — 2k +1) 


k=0 


5.1.5 Find the inverse z-transform of the following: 


(e~? — 2)z 


. (2-e7)(z-— 2) 


(z — 1)? 
73 


a 


z(2z + 3) 


_ (z@— 1)(z? — 5z + 6) 


z(—5z + 22) 


. @+D@—2P 


z(1.4z + 0.08) 


_ (z—0.2)(z — 0.8)? 


z(z — 2) 


.2—z+1 


2z? — 0.3z + 0.25 


i. z2+0.6z + 0.25 


5.1.7 


5.2.1 


5.2.2 


2z(3z — 23) 
j. (2 — 1)(z? — 6z + 25) 


2(3.83z + 11.34) 
k. (z — 2)(z? — 5z + 25) 


z?(—2z7 + 8z — 7) 
I. (z-—D(z-2P 


a. Expanding X/z] as a power series in z~', find the first three terms of X{[n] if 
223 + 132? 
X[z] = of + 15zZ° +Z 
z3+7z?+2z2+1 

b. Extend the procedure used in part (a) to find the first four terms of x/n] if 

Xtz] 2z* + 16z> + 172? + 3z 

z|\= --___ 

w+722+2z+1 
Find x[n] by expanding 


Fire 
(z—y)? 
as a power series in z~!. 


a. In Table 5.1, if the numerator and the denominator powers of X/z] are M and N, respectively, explain why in 
some cases N — M = 0, while in others N — M— 1 or N— M=m (many positive integer). 
b. Without actually finding the z-transform, state what is N — M for X[/z] corresponding to x/n] = y"u[n — 4] 


For a discrete-time signal shown in Fig. P5.2-1 show that 


es 
X[z] = 


z 


l-—z"! 


0 m— | a 
Figure P5.2-1 


Find your answer by using the definition in Eq. (5.1) and by using Table 5.1 and an appropriate property of the z- 
transform. 


Find the z-transform of the signal illustrated in Fig. P5.2-2. Solve this problem in two ways, as in Examples 5.2d and 5.4. 
Verify that the two answers are equivalent. 


xin} 


trtititr. 
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Figure P5.2-2 


5.2.3 


5.2.4 


5.2.5 


5.2.6 


5.2.7 


5.2.8 


5.2.9 


Using only the fact that y”ufn] <= z/(z — y) and properties of the z-transform, find the z-transform of each of the 
following: 


a. nun] 

b. n2y"u[n] 

c. nun] 

d. a”[u[n] — u[n — mJ] 

e. ne2"u[n — m] 

f. (n — 2) (0.5)"~3ujn — 4] 


Using only pair 1 in Table 5.1 and appropriate properties of the z-transform, derive iteratively pairs 2 through 9. In other 
words, first derive pair 2. Then use pair 2 (and pair 1, if needed) to derive pair 3, and so on. 


Find the z-transform of cos (11/4) ufn] using only pairs 1 and 1 Ib in Table 5.1 and a suitable property of the z- 
transform. 


Apply the time-reversal property to pair 6 of Table 5.1 to show that y”u[/(n + 1)] <= —z/(z-y) and the ROC is given by 
IZ < lyl. 

a. If x[n] <> X/z], then show that (—1)"x/n] <=> X/—z]. 

b. Use this result to show that (—y)"ufn] <= zi(z + y). 


c. Use these results to find the z-transform of 
i. [22-1 — (-2)"—"Jufn] 


ii. y"” cos Trnu[n] 


a. If x[n] <=> X/z], then show that 
n 


So xk) iit zX{[z] 
=0 z—1 


b. Use this result to derive pair 2 from pair 1 in Table 5.1. 


A number of causal time-domain functions are shown in Fig. P5.2-9. 


Figure P5.2-9: Various causal time-domain functions. 


List the function of time that corresponds to each of the following functions of z. Few or no calculations are necessary! Be 
careful, the graphs may be scaled differently. 


5.3.1 
5.3.2 


5.3.3 


5.3.4 


5.3.5 


> 


= 
a. (2 — 0.75) 


z? —0.9z//2 
b. 22 —0.9./2z + 0.81 


0.75z 
f. (z — 0.75)? 
z2—z//2 
g. 2— J2z +1 
z~! — §z-5 + 47-6 
h. S(1 — z>!)? 
z 
i z—1.1 
0.2527! 
j. A —z-)d — 0.75z-!) 


Solve Prob. 3.8-16 by the z-transform method. 


. Solve 
y[n + 1] + 2y[n] = x[n + 1] 
when y[0] = 1 and x{n] = e~("~)ujn] 
b. Find the zero-input and the zero-state components of the response. 
a. Find the output y/n] of an LTID system specified by the equation 
2y[n + 2] — 3y[n + 1] + y[n] 
= 4x[n + 2] — 3x[n + 1] 
if the initial conditions are y[—1] = 0, y[—2] = 1, and the input x/n] = (4) "=u/n]. 
b. Find the zero-input and the zero-state components of the response. 
c. Find the transient and the steady-state components of the response. 
ra Prob. 5.3-3 if instead of initial conditions y[—1], y[—2] you are given the auxiliary conditions y[0] = 3/2 and y[1] = 
5/4. 
a. Solve 
4y[n + 2] + 4y[n + 1] + y[n] = x[n + 1] 
with y[—1] = 0, y[—2] = 1, and x/n] = un]. 


b. Find the zero-input and the zero-state components of the response. 


5.3.6 


5.3.7 


5.3.8 


5.3.9 


5.3.10 


5.3.11 


5.3.12 


5.3.13 


5.3.14 


5.3.15 
5.3.16 
5.3.17 
5.3.18 


c. Find the transient and the steady-state components of the response. 


Solve 
y[n + 2] — 3y[n + 1] + 2y[n] = x[n + 1] 


if y[—1] = 2y[—2] = 3, and xfn] = (3)"ufn]. 


Solve 
y[n + 2] — 2y[n + 1] + 2y[n] = x[n] 


with y[—1] = 1, y[—2] = 0, and x/n] = un]. 


Solve 
y[n] + 2y[n — 1] + 2y[n —2] 


= x[a—1]+2x[a —2] 
with y[0] = 0, y[1] = 1, and x/n] = e”ujn]. 


A system with impulse response h/n] = 2(%)"u[n — 1] produces an output y/n] = (—2)"u[n — 1]. Determine the 
corresponding input x/n/j. 


Sally deposits $100 into her savings account on the first day of every month except for each December, when she uses 
her money to buy holiday gifts. Define b/m] as the balance in Sally's account on the first day of month m. Assume Sally 
opens her account in January (m = 0), continues making monthly payments forever (except each December!), and that 
her monthly interest rate is 1%. Sally's account balance satisfies a simple difference equation b/m] = (1.01)b[m — 1] + 
p[m], where p[m] designates Sally's monthly deposits. Determine a closed-form expression for b[m] that is only a 
function of the month m. 


For each impulse response, determine the number of system poles, whether the poles are real or complex, and 
whether the system is BIBO stable. 


a. ha[n] = (—1 + (0.5)")ufn] 
b. ha[n] = (/)"(ufn] — u[n—10}) 


Find the following sums: 
n n 
(i) S k (ii) S : 
k=0 k=0 


[Hint: Consider a system whose output y/n] is the desired sum. Examine the relationship between y/n] and y[n - 1]. 
Note also that y[0] = 0.] 


Find the following sum: 
Ld 
k=O 


[Hint: See the hint for Prob. 5.3-12.] 


Find the following sum: 
n 


So ka! a#l 


[Hint: See the hint for Prob. 5.3-12.] 
Redo Prob. 5.3-12 using the result in Prob. 5.2-8a. 
Redo Prob. 5.3-13 using the result in Prob. 5.2-8a. 


Redo Prob. 5.3-14 using the result in Prob. 5.2-8a. 


a. Find the zero-state response of an LTID system with transfer function 
7 


Pg ee 
Iz] (z + 0.2)(z — 0.8) 


and the input x/n] = e("*)ujn]. 
b. Write the difference equation relating the output y/n] to input x/nj. 


5.3.19 Repeat Prob. 5.3-18 for x[n] = u[n] and 


2z+3 
oe ne 
2 (z — 2) — 3) 


5.3.20 Repeat Prob. 5.3-18 for 
Hil = 
and the input x/n] is 
a. (4) "[n] 
b. (4)-("-2)u[n—2] 
c. (4) un] 
d. (4) "u[n—2] 
5.3.21 Repeat Prob. 5.3-18 for x/n] = u[n] and 


H 2z — 
lz] = z?—1.6z+08 


5.3.22 Find the transfer functions corresponding to each of the systems specified by difference equations in Probs. 5.3-2, 5.3- 
3, 5.3-5, and 5.3-8. 


5.3.23 Find hfnj, the unit impulse response of the systems described by the following equations: 
a. y[n] + 3y[n — 1] + 2y[n — 2] = x[n] + 3x[n — 1] + 3x[n — 2] 
b. y[n + 2] + 2y[n + 1] + y[n] = 2x[n + 2] — x[n + 1] 
c. y[n] — y[n — 1] + 0.5y[n — 2] = x[n] + 2x[n — 1] 
5.3.24 — Find hj[nj, the unit impulse response of the systems in Probs. 5.3-18, 5.3-19, and 5.3-21. 
5.3.25 A system has impulse response h/nj = u[n — 3]. 
a. Determine the impulse response of the inverse system h7"In]. 


b. Is the inverse stable? Is the inverse causal? 


c. Your boss asks you to implement ho'[n] to the best of your ability. Describe your realizable design, taking 
care to identify any deficiencies. 


5.4.1. A system has impulse response given by 
h{n] = (42) + (=) | an 
v8 v8 
This system can be implemented according to Fig. P5.4-1. 
a. Determine the coefficients A, and Az to implement h/n] using the structure shown in Fig. P5.4-1. 


b. What is the zero-state response yo[n] of this system, given a shifted unit step input x/n] = u[n + 3]? 


x[n] yin] 


Figure P5.4-1: Structure to implement h/nj. 


5.4.2 
a. Show the canonic direct form, a cascade and, a parallel realization of 
Hz] 2(3z — 1.8) 
26 
z2—-z+0.16 


b. Find the transpose of the realizations obtained in part (a). 


5.4.3. Repeat Prob. 5.4-2 for 


5z + 2.2 
A(zj=5 
z*+2z+0.16 
5.4.4 Repeat Prob. 5.4-2 for 
3.8z — 1.1 
Alz]= 


(z — 0.2)(z? — 0.6z + 0.25) 
5.4.5 Repeat Prob. 5.4-2 for 
z(1.6z — 1.8) 
A[z]= re Cr Pere 
(z — 0.2)(z* + z + 0.5) 
5.4.6 Repeat Prob. 5.4-2 for 
Hz] z(2z? + 1.3z + 0.96) 
“(2 +0.5)z — 0.4)? 
5.4.7. Realize a system whose transfer function is 
224 + 23 + 0.827 +27 +8 
A[z| = ————_{——— 
Zz 
5.4.8 Realize a system whose transfer function is given by 
6 
A[z] = Sone 
a=) 


5.4.9 This problem demonstrates the enormous number of ways of implementing even a relatively low-order transfer function. 
A second-order transfer function has two real zeros and two real poles. Discuss various ways of realizing such a transfer 
function. Consider canonic direct, cascade, parallel, and the corresponding transposed forms. Note also that interchange 
of cascaded sections yields a different realization. 


5.5.1 Find the amplitude and phase response of the digital filters depicted in Fig. P5.5-1. 


ln] oy x{n] : yin] 
> _& 


{b) 


0.16 


Figure P5.5-1 


5.5.2 Find the amplitude and the phase response of the filters shown in Fig. P5.5-2. [Hint: Express H[e/2] as e/2:50 
Hale }.] 


(a) 


: tetetcie. : 


(b) 


Figure P5.5-2 


5.5.3 Find the frequency response for the moving-average system in Prob. 3.4-3. The input-output equation of this system is 
given by 


4 
y[n] = 3 So xin —k] 
k=0 


a. Input-output relationships of two filters are described by 
i. y[n] = —O.9y[n — 1] + x[n] 
ii. y[n] = O.9y[n — 1] + x[n] 


For each case, find the transfer function, the amplitude response, and the phase response. 
Sketch the amplitude response, and state the type (highpass, lowpass, etc.) of each filter. 


5.5.4 


b. Find the response of each of these filters to a sinusoid x/n] = cosOn for QO = 0.0111 and 0.99Tr. In general 
show that the gain (amplitude response) of the filter (i) at frequency Qo is the same as the gain of the 


filter (ii) at frequency TT — Og 


5.5.5 For an LTID system specified by the equation 
y[a + 1] —O.Sy[n] = x[n + 1] + 0.8x[n] 


a. Find the amplitude and the phase response. 


b. Find the system response y/n] for the input x/n] = cos (0.5k — (t1/3)). 


5.5.6 For an asymptotically stable LTID system, show that the steady-state response to input elnyin] is Hel e)Qnujn]. The 
steady-state response is that part of the response which does not decay with time and persists forever. 


5.5.7 Express the following signals in terms of apparent frequencies. 
a. cos(0.811n + 0) 
b. sin(1.2Trn + 8) 
c. cos(6.9n + 8) 
d. cos(2.81tn + 8) + 2 sin (3.711n + 8) 
e. sinc(tn/2) 
f. sinc(3ttn/2) 
g. sinc(2Trn) 
5.5.8 Show that cos (0.611 + (11/6)) + /3 cos (1.411 + (T1/3)) = 2 cos (0.611 — (T1/6)). 
Pen a. A digital filter has the sampling interval T = 50 us. Determine the highest frequency that can be processed 


by this filter without aliasing. 


b. If the highest frequency to be processed is 50 kHz, determine the minimum value of the sampling 
frequency Fi and the maximum value of the sampling interval T that can be used. 


5.5.10 | Consider the discrete-time system represented by 
ow 
yin] = } 7 0.5)xin — k] 
k=0 


a. Determine and plot the magnitude response |H(e/) of the system. 


b. Determine and plot the phase response ZH(el2) of the system. 
c. Find an efficient block representation that implements this system. 


5.6.1 Pole-zero configurations of certain filters are shown in Fig. P5.6-1. Sketch roughly the amplitude response of these 
filters. 


(a) ({b) 


Figure P5.6-1 


5.6.2 The system y/n] — y[n — 1] = x[n] — x[n — 1] is an all-pass system that has zero phase response. Is there any 
difference between this system and the system y/n] = x[n]? Justify your answer. 


5.6.3 The magnitude and phase responses of a real, stable, LT| system are shown in Fig. P5.6-3. 
a. What type of system is this: lowpass, high-pass, bandpass, or bandstop? 


b. What is the output of this system in response to 
m be 

x\[n] = 2sin | —n + — 
iln] 5 + 4 


c. What is the output of this system in response to 


bd 
x2|[n] = cos | —n 
4 


5.6.4 
5.6.5 
5.6.6 


5.6.7 


5.6.8 


5.6.9 


| : + ~——— Le ca 
0.9 | - 
| ; | 
0.8 | | 4 
; | = 
o7+ | | 
. 0.6} | 4 = 
& OS + | 4 2 0 
= <= 
=o4- | { 
{| | 
0.3 | 4 = \ 
O.2+ \ 4 \ 
O.1F \ | 
 ——— | —7li._.l. . 1.1, 4 
—7 -—7i2 0 wi2 -7 -7/2 0 anf2 @ 


8) Oo 
Figure P5.6-3: Frequency response of a real, stable, LTI system. 


Do Prob. 5.M-1 by graphical procedure. Do the sketches approximately, without using MATLAB. 


Do Prob. 5.M-4 by graphical procedure. Do the sketches approximately, without using MATLAB. 


a. Realize a digital filter whose transfer function is given by 


i 
AGj=- x == 
z-a 


b. Sketch the amplitude response of this filter, assuming |a| < 1. 


c. The amplitude response of this lowpass filter is maximum at QO = 0. The 3 dB bandwidth is the frequency 
at which the amplitude response drops to 0.707 (or 1 /./2) times its maximum value. Determine the 3 dB 
bandwidth of this filter when a = 0.2. 


Design a digital notch filter to reject frequency 5000 Hz completely and to have a sharp recovery on either side of 5000 


Hz to a gain of unity. The highest frequency to be processed is 20 kHz (Fy = 20,000). [Hint: See Example 5.15. 


The zeros should be at e#/7 for w corresponding to 5000 Hz, and the poles are at aeZ”T with a < 1. Leave your 
answer in terms of a. Realize this filter using the canonical form. Find the amplitude response of the filter.] 


Show that a first-order LTID system with a pole at z = r and a zero at z = 1/r(r < 1) is an allpass filter. In other words, 
show that the amplitude response |H[e/2)| of a system with the transfer function 
1 


x—— — 
~ 


H{[z|= r r<l 


zZ—rPT a 


is constant with frequency. This is a first-order allpass filter. [Hint: Show that the ratio of the distances of any point on 
the unit circle from the zero (at z = 1/r) and the pole (at z = r) is a constant 1/r.] 


Generalize this result to show that an LTID system with two poles at z = re*l® and two zeros at z = (1/r)e#® (r < 1)is 
an allpass filter. In other words, show that the amplitude response of a system with the transfer function 
l er 
jé 


z—-e”” |[z-—-e7 


zi ? 
fh) ———— 
(z — rei?)(z — re-J") 


F 2 1 
ooh — 6088 12 
r re 


z2— 2rcos@)z +r? 


is constant with frequency. 


a. If h4[n] and ho[n], the impulse responses of two LTID systems are related by hg[n] = (—1)"h4,[n], then 
show that 
He!) = Hyle*™| 


5.6.10 


5.6.11 


5.7.1 


5.7.2 


5.7.3 


5.7.4 


5.7.5 


5.7.6 


How are the frequency response spectrum Ho[e!2] related to the H, [e/2]. 


b. If H4 [z] represents an ideal lowpass filter with cutoff frequency O,, sketch Hp[el}, What type of filter is 
Ho[e!}? 
Mappings such as the bilinear transformation are useful in the conversion of continuous-time filters to discrete-time 


filters. Another useful type of transformation is one that converts a discrete-time filter into a different type of discrete- 
time filter. Consider a transformation that replaces z with —z. 


a. Show that this transformation converts lowpass filters into highpass filters and highpass filters into lowpass 
filters. 


b. If the original filter is an FIR filter with impulse response h[n], what is the impulse response of the 
transformed filter? 


The bilinear transformation is defined by the rules s = 2(1 7 )T(1+z | ): 


a. Show that this transformation maps the w axis in the s plane to the unit circle z = e/® in the z plane. 
b. Show that this transformation maps to 2 arctan(w 7/2). 


In Chapter 3, we used another approximation to find a digital system to realize an analog system. We showed that an 
analog system specified by Eq. (3.15a) can be realized by using the digital system specified by Eq. (3.15c). Compare 
that solution with the one resulting from the impulse invariance method. Show that one result is a close approximation of 
the other and that the approximation improves as T — 0. 


a. Using the impulse invariance criterion, design a digital filter to realize an analog filter with transfer function 


Ts + 20 
H, (s) = Aired Le IO 
2(s? + 7s + 10) 
b. Show a canonical and a parallel realization of the filter. Use the 1% criterion for the choice of T. 


Use the impulse invariance criterion to design a digital filter to realize the second-order analog Butterworth filter with 
transfer function 


hoe —_—> 
‘s) s+ /2s+1 


Use the 1% criterion for the choice of T. 


Design a digital integrator using the impulse invariance method. Find and give a rough sketch of the amplitude response, 
and compare it with that of the ideal integrator. If this integrator is used primarily for integrating audio signals (whose 
bandwidth is 20 kHz), determine a suitable value for T. 


An oscillator by definition is a source (no input) that generates a sinusoid of a certain frequency Wo. Therefore an 
oscillator is a system whose zero-input response is a sinusoid of the desired frequency. Find the transfer function of a 
digital oscillator to oscillate at 10 kHz by the methods described in parts a and b. In both methods select T so that there 
are 10 samples in each cycle of the sinusoid. 


a. Choose H [Zz] directly so that its zero-input response is a discrete-time sinusoid of frequency QO = wT 
corresponding to 10 kHz. 


b. Choose H,(s) whose zero-input response is an analog sinusoid of 10 kHz. Now use the impulse invariance 
method to determine H[z]. 


c. Show a canonical realization of the oscillator. 


A variant of the impulse invariance method is the step invariance method of digital filter synthesis. In this method, for a 
given H,(s), we design Hz] in Fig. 5.22a such that y(nT) in Fig. 5.22b is identical to y/n] in Fig. 5.22a when x(t) = u(t). 


a. Show that in general 


H{[z] = = “z|(c 2) | 


b. Use this method to design H/z] for 


5.7.7 


5.7.8 


5.7.9 


5.9.1 


5.9.2 


5.9.3 


5.9.4 


5.9.5 


Oe 
S + &, 


c. Use the step invariant method to synthesize a discrete-time integrator and compare its amplitude response 
with that of the ideal integrator. 


H, (s) ad 


Use the ramp-invariance method to synthesize a discrete-time differentiator and integrator. In this method, for a given 
H,(s), we design H/z] such that y(n7) in Fig. 5.22b is identical to y/n] in Fig. 5.22a when x(t) = tu(t). 


In an impulse invariance design, show that if H,(s) is a transfer function of a stable system, the corresponding H/z] is 
also a transfer function of a stable system. 


First-order backward differences provide the transformation rule s = (1— 2 yr 


a. Show that this transformation maps the w axis in the s plane to a circle of radius 1/2 centered at (1/2, 0) in 
the z plane. 


b. Show that this transformation maps the left-half s plane to the interior of the unit circle in the z plane, which 
ensures that stability is preserved. 


Find the z-transform (if it exists) and the corresponding ROC for each of the following signals: 
a. (0.8)"ufn] + 2°uf—(n + 1)] 
b. 2"u[n]—3"u[—(n + 1)] 
c. (0.8)"ufn] + (0.9)"uf—(n + 1)] 
d. [(0.8)" + 3(0.4)"uf—(n + 1)] 
e. [(0.8)" + 3(0.4)"Jujn] 
f. (0.8)"un] + 3(0.4)"u[—n + 1)] 
g. (0.5)!"I 
h. nu[-(n + 1)] 


Find the Inverse 2 tans tonm of 
a 
g-—e£95-2 
when the ROC is 

a. |z>2 

b. e-2 <|z) <2 


rom 4 ce igs 


Use partial fraction expansions, z-transform tables, and a region of convergence (|z| < 1/2) to determine the inverse z- 
transform of 


X(z) = 


I 
(2z + 1)( + 1)(z + 3) 


Consider the system 


z(z— $3) 
H(z) = —— 
(@-%) 


a. Draw the pole-zero diagram for H(z) and identify all possible regions of convergence. 


b. Draw the pole-zero diagram for H~1(z) and identify all possible regions of convergence. 


A discrete-time signal x/n] has a rational z-transform that contains a pole at z = 0.5. Given x4[n] = (*4)"x{n] is absolutely 


summable and x9[n] = (1/4)"x{n] is NOT absolutely summable, determine whether x/n] is left sided, right sided, or two 
sided. Justify your answer! 


5.9.6 Let x[n] be an absolutely summable signal with rational z-transform X(z). X(z) is known to have a pole at z = (0.75 + 
0.75/), and other poles may be present. Recall that an absolutely summable signal satisfies 2”_.. |x[n]| < 00. 


a. Can x[n] be left sided? Explain. 
b. Can x[n] be right sided? Explain. 
c. Can x[n] be two sided? Explain. 


d. Can x{n] be of finite duration? Explain. 


5.9.7 Consider a causal system that has transfer function 
H(z) = —— 
z+0.5 


When appropriate, assume initial conditions of zero. 


a. Determine the output y, /n] of this system in response to x4[n]=(3/4)"u/n]. 
b. Determine the output y2[n] of this system in response to x=(3/4)”. 


5.9.8 Letx/njJ=(—1)"u[n—no]+a"u[—n]. Determine the constraints on the complex number « and the integer ng so that the z- 
transform X(z) exists with region of convergence 1 < |z| < 2. 


5.9.9 Using the definition, compute the bilateral z-transform, including the region of convergence (ROC), of the following 
complex-valued functions: 


a. x4[n] = (— j)" u[-n] + 8[-n] 
b. xg[n] = (j)" cos (n + 1)u[n] 

c. x3[n] = j sinh[n] u[—n+1] 

d. xg[n] = ° ,2-20(2j)"5[n —2k] 


5.9.10 Use partial fraction expansions, z-transform tables, and a region of convergence (0.5 < |z| < 2) to determine the inverse 
z-transform of 


1 
X,(z) = = 
i 1+ Bz-1 + 22-2 — i273 
1 
X>(z) = -—_—_ 
b. a(2) z73(2 —z"')(1 + 2z7') 


5.9.11 Use partial fraction expansions, z-transform tables, and the fact that the systems are stable to determine the inverse z- 
transform of 


, @-HG+e) 
z+1 
H3(z) 
' 2E-DE+4) 


5.9.12 By inserting N zeros between every sample of a unit step, we obtain a signal 
x» 


h{n] = So ain — Nk] 


k=0 
Determine H(z), the bilateral z-transform of h[nj. Identify the number and location(s) of the poles of H(z). 


5.9.13 Determine the zero-state response of a system having a transfer function 


5.9.14 


5.9.15 


5.m.1 


5.m.2 


5.m.3 


A(z] 


~ © + 0.2) —0.8) 


7 


lz] > 0.8 


and an input x/n] given by 


a. xn[nJ= e"u[n] 


b. xn[nJ= 2. u[—(n+1)] 


c. xn[nj=e"u[n]+2"[—(n+1)]] 


For the system in Prob. 5.9-13, determine the zero-state response for the input 
x[n] = 2" a(n] + u[—(n + 1D] 


For the system in Prob. 5.9-13, determine the zero-state response for the input 
—2n 
xfa]=e""[-@ + 1D] 
Consider an LTID system described by the difference equation 4y[n + 2] — y[n] = x[n + 2]+x[n]. 


a. 


b. 


Cc. 


g. 


Plot the pole-zero diagram for this system. 


Plot the system's magnitude response |H(e/)|over-1t <O<T. 


What type of system is this: lowpass, high-pass, bandpass, or bandstop? 


. Is this system stable? Justify your answer. 
. Is this system real? Justify your answer. 


. If the system input is of the form x[n]=cos (Qn), what is the greatest possible amplitude of the output? 


Justify your answer. 


Draw an efficient, causal implementation of this system using only add, scale, and delay blocks. 


One interesting and useful application of discrete systems is the implementation of complex (rather than real) systems. 
A complex system is one in which a real-valued input can produce a complex-valued output. Complex systems that are 
described by constant coefficient difference equations require at least one complex-valued coefficient, and they are 
capable of operating on complex-valued inputs. 


Consider the complex discrete time system 


H(z) = 


a. 


b. 


2 * 
oJ 


z— 0.9e/37/4 


Determine and plot the system zeros and poles. 


Sketch the magnitude response |H(e!”)| of this system over —21t < w < 211. Comment on the system's 
behavior. 


Consider the complex system 


H(z) = 


zl 


2(2? + 0.81/) 


Refer to Prob. 5.M-2 for an introduction to complex systems. 


a. 


b. 


Plot the pole-zero diagram for H(z). 


Plot the system's magnitude response |H(e/)|over-t <O<Tr. 


. Explain why H(z) is a noncausal system. Do not give a general definition of causality; specifically identify 


what makes this system noncausal. 


. One way to make this system causal is to add two poles to H(z). That is, 


cause rs = H z ye eee 
ie) OG aE 


Find poles a and b such that |Hgasual(e)|=|H(e)]. 


. Draw an efficient block implementation of Heausai(Z)- 


5.m.4 


5.m.5 


5.m.6 


5.m.7 


5.m.8 


5.m.9 


5.m.10 


5.m.11 


A discrete-time LTI system is shown in Fig. P5.M-4. 


a. Determine the difference equation that describes this system. 


b. Determine the magnitude response |H(e/®)| for this system and simplify your answer. Plot the magnitude 
response over — TT < Q < Tr. What type of standard filter (lowpass, highpass, bandpass, or bandstop) 
best describes this system? 


c. Determine the impulse response h[n] of this system. 


x[n] yin] 


Figure P5.M-4: Second-order discrete-time system. 


Determine the impulse response h[n] for the system shown in Fig. P5.M-5. Is the system stable? Is the system 
causal? 


xn] 


Figure P5.M-5: Third-order discrete-time system. 
An LTID filter has an impulse response function given by h/nJ=8[n — 1] + 8[n + 1]. 


Determine and carefully sketch the magnitude response |H(e!2)| over the range —Tt < QO < TT. For this range of 
frequencies, is this filter lowpass, highpass, bandpass, or bandstop? 


A causal, stable discrete system has the rather strange transfer function H(z)=cos(z~'). 


a. Write MATLAB code that will compute and plot the magnitude response of this system over an 
appropriate range of digital frequencies O. Comment on the system. 


b. Determine the impulse response h[nj. Plot h[n] over (0 < n < 10). 


c. Determine a difference equation description for an FIR filter that closely approximates the system 


H(z)=cos(z7" ). To verify proper behavior, plot the FIR filter's magnitude response and compare it with the 
magnitude response computed in Prob. 5.M-7a. 


The MATLAB signal processing toolbox function butter helps design digital Butterworth filters. Use MATLAB help to 
learn how butter works. For each of the following cases, design the filter, plot the filter's poles and zeros in the 


complex z plane, and plot the decibel magnitude response 20 logio |H(e®)|. 
a. Design an eighth-order digital lowpass filter with QO, = 11/3. 
b. Design an eighth-order digital highpass filter with QO, = 11/3. 
c. Design an eighth-order digital bandpass filter with passband between 511/24 and 1111/24. 
d. Design an eighth-order digital bandstop filter with stopband between 511/24 and 1111/24. 


The MATLAB signal processing toolbox function cheby1 helps design digital Chebyshev type | filters. A Chebyshev 
type | filter has passband ripple and smooth stopband. Setting the passband ripple to Rp=3 dB, repeat Prob. 5.M-8 
using the chebyl command. With all other parameters held constant, what is the general effect of reducing Rp; the 
allowable passband ripple? 


The MATLAB signal processing toolbox function cheby2 helps design digital Chebyshev type II filters. A Chebyshev 
type II filter has smooth passband and ripple in the stopband. Setting the stopband ripple R,=20 dB down, repeat Prob. 


5.M-8 using the cheby2 command. With all other parameters held constant, what is the general effect of increasing 
Rg, the minimum stopband attenuation? 


The MATLAB signal processing toolbox function e11ip helps design digital elliptic filters. An elliptic filter has ripple in 


both the passband and the stopband. Setting the passband ripple to Rp=3 dB and the stopband ripple Rs=20 dB down, 
repeat Prob. 5.M-8 using the el1lip command. 


Chapter 6: Continuous-Time Signal Analysis-The Fourier Series 


OVERVIEW 


Electrical engineers instinctively think of signals in terms of their frequency spectra and think of systems in terms of their frequency 
response. Even teenagers know about audible portion of audio signals having a bandwidth of about 20 kHz and the need for good- 
quality speakers to respond up to 20 kHz. This is basically thinking in frequency domain. In Chapters 4 and 5 we discussed extensively 
the frequency-domain representation of systems and their spectral response (system response to signals of various frequencies). In 
Chapters 6, 7, 8, and 9 we discuss spectral representation of signals, where signals are expressed as a sum of sinusoids or 
exponentials. Actually, we touched on this topic in Chapters 4 and 5. Recall that the Laplace transform of a continuous-time signal is its 
spectral representation in terms of exponentials (or sinusoids) of complex frequencies. Similarly the z-transform of a discrete-time signal 
is its spectral representation in terms of discrete-time exponentials. However, in the earlier chapters we were concerned mainly with 
system representation, and the spectral representation of signals was incidental to the system analysis. Spectral analysis of signals is 
an important topic in its own right, and now we turn to this subject. 


In this chapter we show that a periodic signal can be represented as a sum of sinusoids (or exponentials) of various frequencies. These 
results are extended to aperiodic signals in Chapter 7 and to discrete-time signals in Chapter 9. The fascinating subject of sampling of 
continuous-time signals is discussed in Chapter 8, leading to A/D (analog-to-digital) and D/A conversion. Chapter 8 forms the bridge 
between the continuous-time and the discrete-time worlds. 


6.1 PERIODIC SIGNAL REPRESENTATION BY TRIGONOMETRIC FOURIER SERIES 
As seen in Section 1.3-3 [Eq. (1.17)], a periodic signal x(t) with period Tg (Fig. 6.1) has the property 


x(t) = x(t + Th) for all { (6.1) 


Figure 6.1: A periodic signal of period To. 


The smallest value of To that satisfies the periodicity condition (6.1) is the fundamental period of x(t). As argued in Section 1.3-3, this 


equation implies that x(t) starts at — co and continues to oo. Moreover, the area under a periodic signal x(t) over any interval of duration 
To is the same; that is, for any real numbers a and b 


a+To b+To 
J x(t)dt -{ x(t)dt (6.2) 
a b 


This result follows from the fact that a periodic signal takes the same values at the intervals of Tp. Hence, the values over any segment 
of duration Tg are repeated in any other interval of the same duration. For convenience, the area under x(t) over any interval of duration 
To will be denoted by 


/ x(t) dt 
Ta 


The frequency of a sinusoid cos 21rfof or sin 2Ttfot is fo and the period is Tg = 1/fg. These sinusoids can also be expressed as cos 
Wot or sin Wot where Wo = 2TIfp is the radian frequency, although for brevity, it is often referred to as frequency (see Section B.2). A 
sinusoid of frequency nfo is said to be the nth harmonic of the sinusoid of frequency fo. 


Let us consider a signal x(t) made up of a sines and cosines of frequency Wg and all of its harmonics (including the zeroth harmonic; 
i.e., dc) with arbitrary amplitudes:!T] 
oo 


X(1) = ao + > Gy COS N@pl + b, sin naot (6.3) 


aml 


The frequency Wo is called the fundamental frequency. 


We now prove an extremely important property: x(t) in Eq. (6.3) is a periodic signal with the same period as that of the fundamental, 
regardless of the values of the amplitudes a, and b,. Note that the period To of the fundamental is 


h=—-=— (6.4) 


and 


Wolo => 2a (6.5) 
To prove the periodicity of x(t), all we need is to show that x(t) = x(f + To). From Eq. (6.3) 
~ 


x(t + Tp) = ay + >a, COS Na@y(t + T)) + b, sinna@y(t + To) 


rel 


oo 
=a+ > Ay COS(NWpl + N@py1)) + b, sin (N@pt + Nw&eT)) 


ral 


From Eq. (6.5), we have nWoTo = 271 n, and 
oS 


x(t + T) = ao + Soa, COS (Naot + 22n) + b, sin(n@pt + 277n) 
n=1 
= 
= Ap + Soa, COS Not + b, sin Nadgf 
n=l 
= x(t) 
We could also infer this result intuitively. In one fundamental period To, the nth harmonic executes n complete cycles. Hence, every 
sinusoid on the right-hand side of Eq. (6.3) executes a complete number of cycles in one fundamental period To. Therefore, at t = To, 
every sinusoid starts as if it were the origin and repeats the same drama over the next Tg seconds, and so on ad infinitum. Hence, the 
sum of such harmonics results in a periodic signal of period To. 


This result shows that any combination of sinusoids of frequencies 0, fo, 2f0,..., kKfp is a periodic signal of period To = 1/fo regardless of 
the values of amplitudes a, and b, of these sinusoids. By changing the values of a, and by, in Eq. (6.3), we can construct a variety of 
periodic signals, all of the same period To(To = 1/fo or 2Tt/Wo). 


The converse of this result is also true. We shall show in Section 6.5-4 that a periodic signal x(t) with a period Tg can be expressed as 


a sum of a sinusoid of frequency fo(fp = 1/Tg) and all its harmonics, as shown in Eq. (6.3).[1] The infinite series on the right-hand side 
of Eq. (6.3) is known as the trigonometric Fourier series of a periodic signal x(t). 


COMPUTING THE COEFFICIENTS OF A FOURIER SERIES 
To determine the coefficients of a Fourier series, consider an integral / defined by 


Ls | COS N@yl COS Ma@pt dl (6.6a) 
To 


where J 79 stands for integration over any contiguous interval of Tg seconds. By using a trigonometric identity (see Section B.7-6), Eq. 
(6.6a) can be expressed as 


t ; if cos (nf + m)wot dt +/ Cos (1 — mM) wot ar (6.6b) 
Ta Ta 
Because cos Wot executes one complete cycle during any interval of duration Tg, cos(n + m)Wot executes (n + m) complete cycles 
during any interval of duration To. Therefore the first integral in Eq. (6.6b), which represents the area under n + m complete cycles of a 
sinusoid, equals zero. The same argument shows that the second integral in Eq. (6.6b) is also zero, except when n = m. Hence / in Eq. 
(6.6) is zero for all n + m. When n = m, the first integral in Eq. (6.6b) is still zero, but the second integral yields 


To 
f=i] dt=—=— 
To 2 
Thus 
0 nem 
| COSN@pl COS Ma@pt dt = < T, (6.7a) 
To ct m=n#~0 


Using similar arguments, we can show that 


/ Sin Nwof SiN M@pt dt = ¢ T;, ({6.7b) 
T% 


and 


| Sin N@pt COS Map dt = 0 for all n and m (6.7¢) 


To 


To determine ao in Eq. (6.3) we integrate both sides of Eq. (6.3) over one period To to yield 


[ x@at=a | dt +>) a. f COS Nast dt +by | sinnoyt a 
Te To ant -.t To To 


Recall that To is the period of a sinusoid of frequency Wo. Therefore functions cos NWof and sin nWot execute n complete cycles over 
any interval of Tg seconds, so that the area under these functions over an interval To is zero, and the last two integrals on the right- 
hand side of the foregoing equation are zero. This yields 


[ soa =a [ dt = aol 
To To 


and 


l 
ay = Tr x(t)dt (6.8a) 


0 /To 
Next we multiply both sides of Eq. (6.3) by cos mwot and integrate the resulting equation over an interval To: 


co 
[ x(1) COS M@pt dt = ay [ COS Mot dt + DB a. f COS Na@pl COS Ma@pt dt 
% a=l To 


T 


+ Dd, | SIN Naf COS Mad rdi| 
To 


The first integral on the right-hand side is zero because it is an area under m integral number of cycles of a sinusoid. Also, the last 
integral on the right-hand side vanishes because of Eq. (6.7c). This leaves only the middle integral, which is also zero for all n + m, 
because of Eq. (6.7a). But n takes on all values from 1 to oo, including m. When n = m, this integral is To/2, according to Eq. (6.7a). 
Therefore, from the infinite number of terms on the right-hand side, only one term survives to yield a,To9 /2 = a@mTo /2 (recall that n = 
m). Therefore 


An Ty 
x(t) cos mayt dt = ——* 
To 


and 


> 
Ay, = — | x(t)cos ma@pt dt (6.8b) 
0 /Ta 


Similarly, by multiplying both sides of Eq. (6.3) by sin nwot and then integrating over an interval Tg, we obtain 


> 
bm = — | x(t)sin ma@ot dt (6.8c) 
0 ¥Tb 


To sum up our discussion, which applies to real or complex x(t), we have shown that a periodic signal x(t) with period Tg can be 
expressed as a sum of a sinusoid of period Tg and its harmonics: 


wo 


x(t) = do + Yea, COS Not +b, sin Naot (6.9) 
nal 
where 
2x 
@ = 2x fo = (6.10) 
Tp 
I 
ao =— | x(tjdt (6.1 1a) 
To Th 


9 
a, =— | x(t)cos nm@ot dt (6.1 1b) 
0 +t 
2 
b, =— | x(t)sin na@ot dt (6.1 1c) 
To Jt, 
COMPACT FORM OF FOURIER SERIES 
The results derived so far are general and apply whether x(f) is a real or a complex function of t. However, when x(t) is real, 
coefficients a, and by, are real for all n, and the trigonometric Fourier series can be expressed in a compact form, using the results in 
Eqs. (B.23) 
wo 
x(t) = Co + > Cy, COS (Naot + 8) (6.12) 


nal 


where C, and 9, are related to a, and by, as [see Eqs. (B.23b) and (B.23c)] 


Co = do (6.13a) 
Cy = Vf dn? + Dy? (6.13b) 
8, = tana (=) (6.13c) 


These results are summarized in Table 6.1. 


Table 6.1: Fourier Series Representation of a Periodic Signal of Period To (Wo = 2Tt /T9) 
= Open table as spreadsheet 


Series Form Coefficient Computation Conversion Formulas 


Trigonometric l ag =co =D 
q in = — SD dt a 
To Th 
[as] a 
2 =jbn= ®n = 2D 
f(t) =ao+ ) Gy COS Not + by sinnwst || 4n = > J (1) cos neo dt an — Jon = Gaol n 
= To Ta 


2 
b,,=— S (1) sin net dt 
Th To 


Co = Do 
Gy=2|D,[n=1 


SQ) =Cot+ > Cy, cos(na@pl + A) Cn = Vn* + by” 


n=1 


ee 


Exponential 
ao 


: l th AT com), 
f@)= ” D,ei"™" Dy = zi fw" dt 
aye ry 


The compact form in Eq. (6.12) uses the cosine form. We could just as well have used the sine form, with terms sin (nWot + 8,) 
instead of cos (nWot + 8,). The literature overwhelmingly favors the cosine form, for no apparent reason except possibly that the cosine 
phasor is represented by the horizontal axis, which happens to be the reference axis in phasor representation. 


Equation (6.11a) shows that ag (or Co) is the average value of x(t) (averaged over one period). This value can often be determined by 
inspection of x(f). 


Because ap and by are real, Cp, and @, are also real. In the following discussion of trigonometric Fourier series, we shall assume real 
x(t), unless mentioned otherwise. 


6.1-1 The Fourier Spectrum 


The compact trigonometric Fourier series in Eq. (6.12) indicates that a periodic signal x(t) can be expressed as a sum of sinusoids of 
frequencies 0 (dc), ?9, 279, .... 129, .... whose amplitudes are Co, Cy, Co, ..., Cp, .... and whose phases are 0, 01, ?9, ..., ?n, --s 
respectively. We can readily plot amplitude C, versus n (the amplitude spectrum) and 8, versus n (the phase spectrum).|t] Because n 
is proportional to the frequency nwo, these plots are scaled plots of C, versus w and 9, versus w. The two plots together are the 
frequency spectra of x(t). These spectra show at a glance the frequency contents of the signal x(t) with their amplitudes and phases. 
Knowing these spectra, we can reconstruct or synthesize the signal x(t) according to Eq. (6.12). Therefore frequency spectra, which are 
an alternative way of describing a periodic signal x(t), are in every way equivalent to the plot of x(t) as a function of t. The frequency 
spectra of a signal constitute the frequency-domain description of x(t), in contrast to the time-domain description, where x(t) is specified 
as a function of time. 


In computing 8, the phase of the nth harmonic from Eq. (6.13c), the quadrant in which 6, lies should be determined from the signs of 
a, and by. For example, if an = —1 and bp, = 1, 9, lies in the third quadrant, and 


Oy, = tan~'(=+) = —135° 
Observe that 
tan~*(=+) A tan-!(1) = 45° 


Although C,,, the amplitude of the nth harmonic as defined in Eq. (6.13b), is positive, we shall find it convenient to allow C,, to take on 
negative values when by, = 0. This will become clear in later examples. 


EXAMPLE 6.1 


Find the compact trigonometric Fourier series for the periodic signal x(t) shown in Fig. 6.2a. Sketch the amplitude and phase spectra 
for x(t). 


Figure 6.2: A periodic signal and (b,c) its Fourier spectra. 
In this case the period Tg = Tt and the fundamental frequency fp = 1/Tg = 1/T Hz, and 
2x 
H=—= 2 rad/s 
a 


Therefore 
oo 


x(t) =a + San cos 2nt + b, sin 2nt 


HIT 


In this example the obvious choice for the interval of integration is from 0 to x. Hence 
Fd 


a=—] edt =0.504 
Jo 
ae ee a 
a,—— | e!* cos2ntdt = 0.504 | ——_—~ 
” TT Jo (, + ~~ 


and 


Se = ( 8n ) 
b= = | e~''* sin 2nt dt = 0.504 14 16a? 


Table 6.2 
= Open table as 
spreadsheet 


[en _ 
(o [os 
[1 |[0.244  |/-75.96 


8n 

0 

[=75.96 | 

[2 [0.125 || -82.87 

[3 [0.084 || -85.24 
[-86.42 | 
[=87.14 | 
[-87.61 | 
[-87.95 _| 


[4 |[0.063 || -86.42 
[5 [0.0504 || -87.14 
[6 |[0.042  |[-87.61 


0.036 || -87.95 


Therefore 


— 2 
x(t) = 0.504 [ + S i+ le + 4n sin 2nt) (6.14) 


n=l 
Also from Eqs. (6.13) 
Co = dy = 0.504 


, =. —<— > 
= et whi ———— Tiga = 0504 ( aoe] 
Gaye tea \ Osten? * 1+ tone 7 1+ 160° 


—b, 
6, = tan~! ( = ) = tan'(—4n) = —tan7!' 4n 
a 


Amplitude and phases of the dc and the first seven harmonics are computed from the above equations and displayed in Table 6.2. We 
can use these numerical values to express x(f) as 


as 2 
x(t) = 0.504 + 0.504)" Trent 008 nt —tan™' 4n) (6.15a) 
x(t) = 0.504 + 0.244 cos (21 — 75.96") + 0.125 cos (4t — 82.87") 
+ 0.084 cos (61 — 85.24") + 0.063 cos (81 — 86.42°}+--- — (6.15b) 


COMPUTER EXAMPLE C6.1 


Following Example 6.1, compute and plot the Fourier coefficients for the periodic signal in Fig. 6.2a. 


In this example, To = Tt and Wo = 2. The expressions for ag, an, Dn, Cp, and 8, are derived in Example 6.1. 


>> n = 1:10; an(l) = 0.504; a n(nt+1) = 0.504*2./(1416*n.%2); 

>> b n(1) = 0; b n(ntl1) = 0.504*8*n./(14+16*n.%*2); 

>> ec n(1l) = a n(i); c n(ntl1) = sqrt (a n(nt1).*2+b n(nt1),%2); 

>> theta n(1) = 0; theta n(nt+l1) = atan2(-b n(nt+1),a n(ntl1)); 

>> n = [0,n]; — — a 

>> clf; subplot(2,2,1); stem(n,a n,'k'); ylabel('a n'); xlabel('n'); 

>> subplot (2,2,2); stem(n,b n,'k™); ylabel('b n'); xlabel('n'); 

>> subplot(2,2,3); stem(c n,'k'); ylabel('c n'); xlabel('n'); 

>> subplot (2,2,4); stem(n,theta n,'k'); ylabel('\theta n [rad]'); xlabel('n'); 


6, (rad) 


0 2 4 6 


Figure C6.1 


The amplitude and phase spectra for x(t), in Fig. 6.2b and 6.2c, tell us at a glance the frequency composition of x(t), that is, the 
amplitudes and phases of various sinusoidal components of x(t). Knowing the frequency spectra, we can reconstruct x(t), as shown on 
the right-hand side of Eq. (6.15b). Therefore the frequency spectra (Fig. 6.2b, 6.2c) provide an alternative description-the frequency- 
domain description of x(t). The time-domain description of x(t) is shown in Fig. 6.2a. A signal, therefore, has a dual identity: the time- 
domain identity x(t) and the frequency-domain identity (Fourier spectra). The two identities complement each other; taken together, they 
provide a better understanding of a signal. 


An interesting aspect of Fourier series is that whenever there is a jump discontinuity in x(t), the series at the point of discontinuity 
converges to an average of the left-hand and right-hand limits of x(t) at the instant of discontinuity. !11 In the present example, for 


instance, x(t) is discontinuous at tf = 0 with x(0*) = 1 and x(0-) = x(TT) = e/2 = 0.208. The corresponding Fourier series converges to 
a value (1 + 0.208)/2 = 0.604 at t = 0. This is easily verified from Eq. (6.15b) by setting tf = 0. 


EXAMPLE 6.2 


Find the compact trigonometric Fourier series for the triangular periodic signal x(t) shown in Fig. 6.3a, and sketch the amplitude and 
phase spectra for x(t). 


Figure 6.3: (a) A triangular periodic signal and (b, c) its Fourier spectra. 


In this case the period To = 2. Hence 


2a 
WO = —— =7 
2 


and 
ro *] 


x(t) =a + > cos mrt + b, sinnzt 


n=l 


where 


2At It} < 4 
x(t) = 
2A(1 —1) k <t<§ 


Here it will be advantageous to choose the interval of integration from —1/2 to 3/2 rather than 0 to 2. 


A glance at Fig. 6.3a shows that the average value (dc) of x(f) is zero, so that ag = 0. Also 


9 3/2 
Z= al x(t) cos nztdt 
2 J-1/2 
1/2 3/2 
= 2At cos naitdt + 2A(1 —t)cos nztdt 
1/2 1/2 


Detailed evaluation of these integrals shows that both have a value of zero. Therefore 
An = 0 


1/2 3/2 
b,, - | 2Al sin nz dt +/ 2A(1 —f)sin nzidi 
1/2 1/2 


Detailed evaluation of these integrals yields, in turn, 


WIT 
= -sin | — 
n> 
0 n even 
8A 
ET n= 1,5,9, 13,... 
— nt 
8A 
“ae = SF, TT IS san 
nn“ 
Therefore 
8A 1 | 1 
= — | cj —_— = Cin 2 a= ¢} —— 3 aes f 
x(t) = sine 5 sin 3a7t + 3 sin 5x1 9 sin7at + (6.16) 


To plot Fourier spectra, the series must be converted into compact trigonometric form as in Eq. (6.12). In this case this is readily done 
by converting sine terms into cosine terms with a suitable phase shift. For example, 
sin kt = cos (kt — 90°) 

— sin kt = cos (kt + 90°) 
By using these identities, Eq. (6.16) can be expressed as 

8A 1 l 
x(t) = —> | cos (wt — 90°) + — cos (37rt + 90°) + — cos (Sart — 90°) 

x? 9 25 

l 
— cos (77rt + 90°) +--- 
+ 9 ( + 90°) 


In this series all the even harmonics are missing. The phases of the odd harmonics alternate from —90° to 90°. Figure 6.3 shows 
amplitude and phase spectra for x(t). 


EXAMPLE 6.3 
A periodic signal x(t) is represented by a trigonometric Fourier series 
x(t) =2+3cos2r + 4sin2¢ + 2 sin (31 + 30°) — cos (7t + 150°) 


Express this series as a compact trigonometric Fourier series and sketch amplitude and phase spectra for x(t). 


In compact trigonometric Fourier series, the sine and cosine terms of the same frequency are combined into a single term and all terms 
are expressed as cosine terms with positive amplitudes. Using Eqs. (6.12), (6.13b), and (6.13c), we have 


3 cos 24 + 4sin 2¢ = 5 cos (21 — 53.13°) 


Also 
sin (3¢ + 30°) = cos (3r + 30° — 90°) = cos (3t — 60°) 


and 


— cos (7t + 150°) = cos (7t + 150° — 180°) = cos (71 — 30°) 


Therefore ; 
x(t) = 2 +5 cos (2t — 53.13°) + 2 cos (31 — 60°) + cos (71 — 30°) 


In this case only four components (including dc) are present. The amplitude of dc is 2. The remaining three components are of 
frequencies Ww = 2, 3, and 7 with amplitudes 5, 2, and 1 and phases —53.13°, —60°, and — 30°, respectively. The amplitude and phase 
spectra for this signal are shown in Fig. 6.4a and 6.4b, respectively. 
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Figure 6.4: Fourier spectra of the signal. 


EXAMPLE 6.4 


Find the compact trigonometric Fourier series for the square-pulse periodic signal shown in Fig. 6.5a and sketch its amplitude and 
phase spectra. 


Figure 6.5: (a) A square pulse periodic signal and (b) its Fourier spectra. 


Here the period is Tg = 21 and Wo = 2Tt/Tp = 1. Therefore 
oo 

x(t) = + > cos nt + b, sin nt 
n=! 


where 


I 
b= x(t)dt 
0 JT) 


From Fig. 6.5a, it is clear that a proper choice of region of integration is from —t1 to Tr. But since x(t) = 1 only over (—Tr/2, Tr/2) and 
x(t) = 0 over the remaining segment, 


i ff? I 
=e dt=- 
"0 2x J 2 


We could have found ao, the average value of x(t), to be 1/2 merely by inspection of x(t) in Fig. 6.5a. Also, 


1 snl? 2 nx 
i= — | cosntdt = — sin | — 
et ee nw 2 


0 n even 


ee, n=1,5,9,13,... 


-— n= 3,7,11,15,... 


1 . 
b, = — sin ni dit =0 
oS x/2 


Therefore 


2 1 1 1 
H==-+ = (cos f— =cos3f + = cos St - 7 cost +) (6.17) 


3 


Observe that b, = 0 and all the sine terms are zero. Only the cosine terms appear in the trigonometric series. The series is therefore 
already in the compact form except that the amplitudes of alternating harmonics are negative. Now by definition, amplitudes C,, are 
positive [see Eq. (6.13b)]. The negative sign can be accommodated by associating a proper phase, as seen from the trigonometric 
identity!T] 
— cos xX = cos (x — 7) 
Using this fact, we can express the series in (6.17) as 

7 


1 2 1 1 
x(t) = = + — |cOs wot + — cos (3a@of — 7) + — cos Saft 
2 58 3 5 


= 


l l 
7 COS (7a ot — 2) + 9 COS D@yt + --- 


This is the desired form of the compact trigonometric Fourier series. The amplitudes are 


1 
Co — 2 
0 n even 
C; _ 2 
— n odd 
wn 
0 for all mn # 3,7, 11, 15,... 


a 
—X “4m 3,7, 11, 15,... 


We might use these values to plot amplitude and phase spectra. However, we can simplify our task in this special case if we allow 
amplitude C,, to take on negative values. If this is allowed, we do not need a phase of —Trt to account for the sign as seen from Eq. 
(6.17). This means that phases of all components are zero, and we can discard the phase spectrum and manage with only the 
amplitude spectrum, as shown in Fig. 6.5b. Observe that there is no loss of information in doing so and that the amplitude spectrum in 
Fig. 6.5b has the complete information about the Fourier series in Eq. (6.17). Therefore, whenever all sine terms vanish (bp = 0), it is 


convenient to allow C,, to take on negative values. This permits the spectral information to be conveyed by a single spectrum. !T] 


Let us investigate the behavior of the series at the points of discontinuities. For the discontinuity at f = Tr/2, the values of x(t) on either 


sides of the discontinuity are x((11/2)~) = 1 and x((11/2)*) = 0. We can verify by setting t = 11/2 in Eq. (6.17) that x(11/2) = 0.5, which is 
a value midway between the values of x(t) on the either sides of the discontinuity at t = Tr/2. 


6.1-2 The Effect of Symmetry 


The Fourier series for the signal x(t) in Fig. 6.2a (Example 6.1) consists of sine and cosine terms, but the series for the signal x(f) in 
Fig 6.3a (Example 6.2) consists of sine terms only and the series for the signal x(t) in Fig. 6.5a (Example 6.4) consists of cosine terms 
only. This is no accident. We can show that the Fourier series of any even periodic function x(t) consists of cosine terms only and the 


series for any odd periodic function x(t) consists of sine terms only. Moreover, because of symmetry (even or odd), the information of 
one period of x(f) is implicit in only half the period, as seen in Figs. 6.3a and 6.5a. In these cases, knowing the signal over a half-period 
and knowing the kind of symmetry (even or odd), we can determine the signal waveform over a complete period. For this reason, the 
Fourier coefficients in these cases can be computed by integrating over only half the period rather than a complete period. To prove this 
result, recall that 

1 To/2 
a==> x(t) dt 

To J 15/2 


> plo/2 
lh, = = / x(t) cosna@pt dt 
To . 


Tp /2 


PA To/ 
= =| X(t) sin Nwol dt 
To —T/2 


Recall also that cos nWot is an even function and sin NWof is an odd function of ¢. If x(t) is an even function of t, then x(t) cos NWoft is 
also an even function and x(t) sin nwot is an odd function of t (see Section 1.5-1). Therefore, following from Eqs. (1.33a) and (1.33b), 


2? Te/2 
= = | x(t)dt (6.18a) 
To 6 
To/2 
a= x(1) COS N@ot dt (6.18b) 
To o 
b, = 0 (6.18c) 
Similarly, if x(t) is an odd function of ¢, then x(t) cos nWot is an odd function of t and x(t) sin nWoft is an even function of t. Therefore 
a, = 0 for all n (6.19) 
4 Ty /2 
bh = = | x(f) sin Nwot dt (6.19b) 
To Jo 


Observe that because of symmetry, the integration required to compute the coefficients need be performed over only half the period. 


If a periodic signal x(t) shifted by half the period remains unchanged except for a sign-that is, if 


Ty 
tL f= peg) (6.20) 


the signal is said to have a half-wave symmetry. It can be shown that for a signal with a half-wave symmetry, all the even-numbered 
harmonics vanish (see Prob. 6.1-5). The signal in Fig. 6.3a is an example of such a symmetry. The signal in Fig. 6.5a also has this 
symmetry, although it is not obvious owing to a dc component. If we subtract the dc component of 0.5 from this signal, the remaining 
signal has a half-wave symmetry. For this reason this signal has a dc component 0.5 and only the odd harmonics. 


EXERCISE E6.1 — 


Find the compact trigonometric Fourier series for periodic signals shown in Fig. 6.6. Sketch their amplitude «> 
and phase spectra. Allow C,, to take on negative values if b, = 0 so that the phase spectrum can be - 
eliminated. [Hint: Use Eqs. (6.18) and (6.19) for appropriate symmetry conditions.] 


Figure 6.6: Periodic signals. 


Answers 


| 4 l l l 
1Oj=---— — t -_ 3rt ——cos 4 
(t) . os (cos mt 4°08 2x + 9 09S 1T 16 °° Th+- -) 


a. 
_ 2A 1 | 
x(t) sin xt — sin 2nt+ 3 sin 3x — q sin 4nt+- 
2A l l 
=— bos (at — 90°) + 5 cos (2x6 + 90°) + = cos Gat — 90") 
x : 
| 
+ —cos (4at + 90°) +--- 
b. 4 


6.1-3 Determining the Fundamental Frequency and Period 


We have seen that every periodic signal can be expressed as a sum of sinusoids of a fundamental frequency Wo and its harmonics. 
One may ask whether a sum of sinusoids of any frequencies represents a periodic signal. If so, how does one determine the period? 
Consider the following three functions: 


x(t) = 2+ 700s (44 +6) +3 cos (21 +) + Scos (Zt +45) 
xX2(t) = 2cos (2t + 6) + 5sin (rt + 0) 


x3(t) = 3sin (3V2t + 6) + 7cos (6721 + ¢) 


Recall that every frequency in a periodic signal is an integer multiple of the fundamental frequency Wo. Therefore the ratio of any two 
frequencies is of the form m/n, where m and n are integers. This means that the ratio of any two frequencies is a rational number. 
When the ratio of two frequencies is a rational number, the frequencies are said to be harmonically related. 


The largest number of which all the frequencies are integer multiples is the fundamental frequency. In other words, the fundamental 
frequency is the greatest common factor (GCF) of all the frequencies in the series. The frequencies in the spectrum of x4(f) are 1/2, 
2/3, and 7/6 (we do not consider dc). The ratios of the successive frequencies are 3:4 and 4:7, respectively. Because both these 
numbers are rational, all the three frequencies in the spectrum are harmonically related, and the signal x4(¢) is periodic. The GCF, that 


is, the greatest number of which 1/2, 2/3, and 7/6 are integer multiples, is 1/6.'T) Moreover, 3(1/6) = 1/2, 4(1/6) = 2/3, and 7(1/6) = 7/6. 
Therefore the fundamental frequency is 1/6, and the three frequencies in the spectrum are the third, fourth, and seventh harmonics. 
Observe that the fundamental frequency component is absent in this Fourier series. 


The signal x(t) is not periodic because the ratio of two frequencies in the spectrum is 2/Tr, which is not a rational number. The signal 
X3(t) is periodic because the ratio of frequencies 3./2 and 6/2 is 1/2, a rational number. The greatest common factor of 3.\/2 and 6\/2 
is 3/2. Therefore the fundamental frequency wo = 3/2, and the period 


_ 2n _ v2, 
3/2) 3 


EXERCISE E6.2 


Determine whether the signal 
x(t) = cos (3 + 30°) + sin (34 +45”) 


>) 


is periodic. If it is periodic, find the fundamental frequency and the period. What harmonics are present in 
x(t)? 


Answers 


Periodic with Wo = 2/15 and period Tg = 15tt. The fifth and sixth harmonics. 


A HISTORICAL NOTE: BARON JEAN-BAPTISTE-JOSEPH FOURIER (1768-1830) 
The Fourier series and integral comprise a most beautiful and fruitful development, which serves as an indispensable instrument in the 


treatment of many problems in mathematics, science, and engineering. Maxwell was so taken by the beauty of the Fourier series that 
he called it a great mathematical poem. In electrical engineering, it is central to the areas of communication, signal processing, and 
several other fields, including antennas, but its initial reception by the scientific world was not enthusiastic. In fact, Fourier could not get 
his results published as a paper. 


Fourier, a tailor's son, was orphaned at age 8 and educated at a local military college (run by Benedictine monks), where he excelled in 
mathematics. The Benedictines prevailed upon the young genius to choose the priesthood as his vocation, but revolution broke out 
before he could take his vows. Fourier joined the people's party. But in its early days, the French Revolution, like most such upheavals, 
liquidated a large segment of the intelligentsia, including prominent scientists such as Lavoisier. Observing this trend, many intellectuals 
decided to leave France to save themselves from a rapidly rising tide of barbarism. Fourier, despite his early enthusiasm for the 
Revolution, narrowly escaped the guillotine twice. It was to the everlasting credit of Napoleon that he stopped the persecution of the 
intelligentsia and founded new schools to replenish their ranks. The 26-year-old Fourier was appointed chair of mathematics at the 


newly created Ecole Normale in 1794.[1] 


Napoleon was the first modern ruler with a scientific education, and he was one of the rare persons who are equally comfortable with 
soldiers and scientists. The age of Napoleon was one of the most fruitful in the history of science. Napoleon liked to sign himself as 
"member of Institut de France" (a fraternity of scientists), and he once expressed to Laplace his regret that "force of circumstances has 


led me so far from the career of a scientist."/2] Many great figures in science and mathematics, including Fourier and Laplace, were 
honored and promoted by Napoleon. In 1798 he took a group of scientists, artists, and scholars-Fourier among them-on his Egyptian 
expedition, with the promise of an exciting and historic union of adventure and research. Fourier proved to be a capable administrator of 
the newly formed Institut d'Egypte, which, incidentally, was responsible for the discovery of the Rosetta stone. The inscription on this 
stone in two languages and three scripts (hieroglyphic, demotic, and Greek) enabled Thomas Young and Jean-Frangois Champollion, a 
protégé of Fourier, to invent a method of translating hieroglyphic writings of ancient Egypt-the only significant result of Napoleon's 
Egyptian expedition. 


Back in France in 1801, Fourier briefly served in his former position as professor of mathematics at the Ecole Polytechnique in Paris. In 
1802 Napoleon appointed him the prefect of Isére (with its headquarters in Grenoble), a position in which Fourier served with distinction. 
Fourier was created Baron of the Empire by Napoleon in 1809. Later, when Napoleon was exiled to Elba, his route was to take him 
through Grenoble. Fourier had the route changed to avoid meeting Napoleon, which would have displeased Fourier's new master, King 
Louis XVIII. Within a year, Napoleon escaped from Elba and returned to France. At Grenoble, Fourier was brought before him in 
chains. Napoleon scolded Fourier for his ungrateful behavior but reappointed him the prefect of Rhéne at Lyons. Within four months 
Napoleon was defeated at Waterloo and was exiled to St. Helena, where he died in 1821. Fourier once again was in disgrace as a 
Bonapartist and had to pawn his effects to keep himself alive. But through the intercession of a former student, who was now a prefect 
of Paris, he was appointed director of the statistical bureau of the Seine, a position that allowed him ample time for scholarly pursuits. 
Later, in 1827, he was elected to the powerful position of perpetual secretary of the Paris Academy of Science, a section of the Institut 


de France. !°1. 


While serving as the prefect of Grenoble, had Fourier carried on his elaborate investigation of the propagation of heat in solid bodies, 
which led him to the Fourier series and the Fourier integral. On December 21, 1807, he announced these results in a prize paper on 
the theory of heat. Fourier claimed that an arbitrary function (continuous or with discontinuities) defined in a finite interval by an 
arbitrarily capricious graph can always be expressed as a sum of sinusoids (Fourier series). The judges, who included the great French 
mathematicians Laplace, Lagrange, Legendre, Monge, and LaCroix, admitted the novelty and importance of Fourier's work but criticized 
it for lack of mathematical rigor and generality. Lagrange thought it incredible that a sum of sines and cosines could add up to anything 
but an infinitely differentiable function. Moreover, one of the properties of an infinitely differentiable function is that if we know its 
behavior over an arbitrarily small interval, we can determine its behavior over the entire range (the Taylor-Maclaurin series). Such a 


function is far from an arbitrary or a capriciously drawn graph.!4] Laplace had additional reason to criticize Fourier's work. Laplace and 
his students had already approached the problem of heat conduction by a different angle, and Laplace was reluctant to accept the 


superiority of Fourier's method.!! Fourier thought the criticism unjustified but was unable to prove his claim because the tools required 
for operations with infinite series were not available at the time. However, posterity has proved Fourier to be closer to the truth than his 
critics. This is the classic conflict between pure mathematicians and physicists or engineers, as we saw earlier (Chapter 4) in the life of 
Oliver Heaviside. In 1829 Dirichlet proved Fourier's claim concerning capriciously drawn functions with a few restrictions (Dirichlet 
conditions). 


Although three of the four judges were in favor of publication, Fourier's paper was rejected because of vehement opposition by 
Lagrange. Fifteen years later, after several attempts and disappointments, Fourier published the results in expanded form as a text, 
Théorie analytique de la chaleur, which is now a classic. 


[tlin Eq. (6.3), the constant term ag corresponds to the cosine term for n = 0 because cos (0 x Wo)t = 1. However, sin (0 x Wo)t = 0. 
Hence, the sine term for n = 0 is nonexistent. 


[t] Strictly speaking, this statement applies only if a periodic signal x(t) is a continuous function of t. However, Section 6.5-4 shows that 
it can be applied even for discontinuous signals, if we interpret the equality in Eq. (6.3), not in the ordinary sense, but in the mean- 
square sense. This means that the power of the difference between the periodic signal x(t) and its Fourier series on the right-hand side 
of Eq. (6.3) approaches zero as the number of terms in the series approach infinity. 


[t]The amplitude C,, by definition here, is nonnegative. Some authors define amplitude A, that can take positive or negative values and 
magnitude C,, = |A,| that can only be nonnegative. Thus, what we call amplitude spectrum becomes magnitude spectrum. The 
distinction between amplitude and magnitude, although useful, is avoided in this book in the interest of keeping definitions of essentially 
similar entities to a minimum. 


[T]This behavior of the Fourier series is dictated by its convergence in the mean, discussed later in Sections 6.2 and 6.5. 


[tlBecause cos (x + TT) = — cos x, we could have chosen the phase Tr or —TT. In fact, cos (x + Nit) = — cos x for any odd integral 
value of N. Therefore the phase can be chosen as + Nt, where N is any convenient odd integer. 


[TlHere, the distinction between amplitude A, and magnitude C, = |A,| would have been useful. But, for the reason mentioned in the 
footnote on page 600, we refrain from this distinction formally. 


[tlThe greatest common factor of a4/b4, ag/bo, ..., Am/bm is the ratio of the GCF of the numerators set (a4, a9,..., @jm) to the LCM 
(least common multiple) of the denominator set (61, 69, ..., Dm). For instance, for the set (2/3, 6/7, 2), the GCF of the numerator set (2, 
6, 2) is 2; the LCM of the denominator set (3, 7, 1) is 21. Therefore 2/21 is the largest number of which 2/3, 6/7, and 2 are integer 
multiples. 


(Bell, E. T. Men of Mathematics. Simon & Schuster, New York, 1937. 

[2]Durant, Will, and Ariel Durant. The Age of Napoleon, Part XI in The Story of Civilization Series. Simon & Schuster, New York, 1975. 
[3lCalinger, R. Classics of Mathematics, 4th ed. Moore Publishing, Oak Park, IL, 1982. 

[4]_Lanczos, C. Discourse on Fourier Series. Oliver Boyd, London, 1966. 


[S]kKérner, T. W. Fourier Analysis. Cambridge University Press, Cambridge, UK, 1989. 


6.2 EXISTENCE AND CONVERGENCE OF THE FOURIER SERIES 


For the existence of the Fourier series, coefficients ag, a,j, and by, in Eqs. (6.11) must be finite. It follows from Eqs. (6.11a), (6.11b), 
and (6.11c) that the existence of these coefficients is guaranteed if x(t) is absolutely integrable over one period; that is, 


Ix(t)|dt < co (6.22) 
To 


However, existence, by itself, does not inform us about the nature and the manner in which the series converges. We shall first discuss 
the notion of convergence. 


6.2-1 Convergence of a Series 


The key to many puzzles lies in the nature of the convergence of the Fourier series. Convergence of infinite series is a complex 
problem. It took mathematicians several decades to understand the convergence aspect of the Fourier series. We shall barely scratch 
the surface here. 


Nothing annoys a student more than the discussion of convergence. Have we not proved, they ask, that a periodic signal x(t) can be 
expressed as a Fourier series? Then why spoil the fun by this annoying discussion? All we have shown so far is that a signal 
represented by a Fourier series in Eq. (6.3) is periodic. We have not proved the converse, that every periodic signal can be expressed 
as a Fourier series. This issue will be tackled later, in Section 6.5-4, where it will be shown that a periodic signal can be represented by 
a Fourier series, as in Eq. (6.3), where the equality of the two sides of the equation is not in the ordinary sense, but in the mean- 
square sense (explained later in this discussion). But the astute reader should have been skeptical of the claims of the Fourier series to 


represent discontinuous functions in Figs. 6.2a and 6.5a. If x(t) has a jump discontinuity, say at t = 0, then x(0*), x(0), and x(07) are 
generally different. How could a series consisting of the sum of continuous functions of the smoothest type (sinusoids) add to one value 
at t= 07 and a different value at t = 0 and yet another value at t = 0*? The demand is impossible to satisfy unless the math involved 
executes some spectacular acrobatics. How does a Fourier series act under such conditions? Precisely for this reason, the great 
mathematicians Lagrange and Laplace, two of the judges examining Fourier's paper, were skeptical of Fourier's claims and voted 
against publication of the paper that later became a classic. 


There are also other issues. In any practical application, we can use only a finite number of terms in a series. If, using a fixed number of 
terms, the series guarantees convergence within an arbitrarily small error at every value of t, such a series is highly desirable, and is 


called an uniformly convergent series. If a series converges at every value of t, but to guarantee convergence within a given error 
requires different number of terms at different ¢, then the series is still convergent, but is less desirable. It goes under the name 
pointwise convergent series. 


Finally, we have the case of a series that refuses to converge at some t, no matter how many terms are added. But the series may 
converge in the mean, that is, the energy of the difference between x(t) and the corresponding finite term series approaches zero as 


the number of terms approaches infinity.{1], To explain this concept, let us consider representation of a function x(t) by an infinite series 
oo 
x(t) = D> z(t) (6.23) 
a=! 


Let the partial sum of the first N terms of the series on the right-hand side be denoted by xj, (f), that is, 


N 
xw(t) = S> z(t) (6.24) 
n=! 
If we approximate x(t) by x,y (f) (the partial sum of the first N terms of the series), the error in the approximation is the difference x(t) — 
X(t). The series converges in the mean to x(t) in the interval (0, To) if 


To 
[ Ix(t) —xw(0)|? dt > 0 as N->& (6.25) 


Hence, the energy of the error x(t) — x,(t) approaches zero as N — oo. This form of convergence does not require for the series to be 
equal to x(t) for all ¢. It just requires the energy of the difference (area under |x(t) — xy (t)|2) to vanish as N — oo. Superficially it may 
appear that if the energy of a signal over an interval is zero, the signal (the error) must be zero everywhere. This is not true. The signal 
energy can be zero even if there are nonzero values at finite number of isolated points. This is because although the signal is nonzero 
at a point (and zero everywhere else), the area under its square is still zero. Thus, a series that converges in the mean to x(t) need not 
converge to x(t) at a finite number of points. This is precisely what happens to the Fourier series when x(t) has jump discontinuities. 
This is also what makes Fourier series convergence compatible with the Gibbs phenomenon, to be discussed later in this section. 


There is a simple criterion for ensuring that a periodic signal x(t) has a Fourier series that converges in the mean. The Fourier series 
for x(t) converges to x(t) in the mean if x(t) has a finite energy over one period, that is, 


Ix(t)[> dt < 00 (6.26) 
To 


Thus, the periodic signal x(t), having a finite energy over one period, guarantees the convergence in the mean of its Fourier series. In 
all the examples discussed so far, condition (6.26) is satisfied, and hence the corresponding Fourier series converges in the mean. 
Condition (6.26), like condition (6.22), guarantees that the Fourier coefficients are finite. 


We shall now discuss an alternate set of criteria, due to Dirichlet, for convergence of the Fourier series. 


DIRICHLET CONDITIONS 

Dirichlet showed that if x(t) satisfies certain conditions (Dirichlet conditions), its Fourier series is guaranteed to converge pointwise at all 
points where x(t) is continuous. Moreover, at the points of discontinuities, x(t) converges to the value midway between the two values 
of x(t) on either sides of the discontinuity. These conditions are: 


1. The function x(t) must be absolutely integrable; that is, it must satisfy Eq. (6.22). 
2. The function x(t) must have only a finite number of finite discontinuities in one period. 
3. The function x(t) must contain only a finite number of maxima and minima in one period. 


All practical signals, including those in Examples 6.1-6.4, satisfy these conditions. 


6.2-2 The Role of Amplitude and Phase Spectra in Waveshaping 


The trigonometric Fourier series of a signal x(t) shows explicitly the sinusoidal components of x(t). We can synthesize x(t) by adding 
the sinusoids in the spectrum of x(t). Let us synthesize the square-pulse periodic signal x(t) of Fig. 6.5a by adding successive 
harmonics in its spectrum step by step and observing the similarity of the resulting signal to x(t). The Fourier series for this function as 
found in Eq. (6.17) is 


x) = 5 + (cost Seti eee Seni’ ) 
ee 3 5" 7 7 


We start the synthesis with only the first term in the series (n = 0), a constant 1/2 (dc); this is a gross approximation of the square 
wave, as shown in Fig. 6.7a. In the next step we add the dc (n = 0) and the first harmonic (fundamental), which results in a signal 
shown in Fig. 6.7b. Observe that the synthesized signal somewhat resembles x(t). It is a smoothed-out version of x(t). The sharp 
corners in x(t) are not reproduced in this signal because sharp corners mean rapid changes, and their reproduction requires rapidly 
varying (i.e., higher-frequency) components, which are excluded. Figure 6.7c shows the sum of dc, first, and third harmonics (even 
harmonics are absent). As we increase the number of harmonics progressively, as shown in Fig. 6.7d (sum up to the fifth harmonic) and 
6.7e (sum up to the nineteenth harmonic), the edges of the pulses become sharper and the signal resembles x(t) more closely. 


ASYMPTOTIC RATE OF AMPLITUDE SPECTRUM DECAY 

Figure 6.7 brings out one interesting aspect of the Fourier series. Lower frequencies in the Fourier series affect the large-scale behavior 
of x(t), whereas the higher frequencies determine the fine structure such as rapid wiggling. Hence, sharp changes in x(t), being a part 
of fine structure, necessitate higher frequencies in the Fourier series. The sharper the change [the higher the time derivative x(f)], the 
higher are the frequencies needed in the series. 


(b) 


(d) 


Figure 6.7: Synthesis of a square-pulse periodic signal by successive addition of its harmonics. 


The amplitude spectrum indicates the amounts (amplitudes) of various frequency components of x(t). If x(t) is a smooth function, its 
variations are less rapid. Synthesis of such a function requires predominantly lower-frequency sinusoids and relatively small amounts of 
rapidly varying (higher-frequency) sinusoids. The amplitude spectrum of such a function would decay swiftly with frequency. To 
synthesize such a function we require fewer terms in the Fourier series for a good approximation. On the other hand, a signal with 
sharp changes, such as jump discontinuities, contains rapid variations, and its synthesis requires relatively large amount of high- 
frequency components. The amplitude spectrum of such a signal would decay slowly with frequency, and to synthesize such a function, 
we require many terms in its Fourier series for a good approximation. The square wave x(t) is a discontinuous function with jump 
discontinuities, and therefore its amplitude spectrum decays rather slowly, as 1/n [see Eq. (6.17)]. On the other hand, the triangular 
pulse periodic signal in Fig. 6.3a is smoother because it is a continuous function (no jump discontinuities). Its spectrum decays rapidly 


with frequency as 1/n? [see Eq. (6.16)]. 


We can show that!®] that if the first k — 1 derivatives of a periodic signal x(t) are continuous and the kth derivative is discontinuous, 
then its amplitude spectrum c, decays with frequency at least as rapidly as 1/nk*1_ This result provides a simple and useful means for 


predicting the asymptotic rate of convergence of the Fourier series. In the case of the square-wave signal (Fig. 6.5a), the zeroth 
derivative of the signal (the signal itself) is discontinuous, so that k = 0. For the triangular periodic signal in Fig. 6.3a, the first derivative 


is discontinuous; that is, k = 1. For this reason the spectra of these signals decay as 1/n and 1/n?, respectively. 


PHASE SPECTRUM: THE WOMAN BEHIND A SUCCESSFUL MANIT] 


The role of the amplitude spectrum in shaping the waveform x(t) is quite clear. However, the role of the phase spectrum in shaping this 
waveform is less obvious. Yet, the phase spectrum, like the woman behind a successful man, plays an equally important role in 
waveshaping. We can explain this role by considering a signal x(t) that has rapid changes such as jump discontinuities. To synthesize 
an instantaneous change at a jump discontinuity, the phases of the various sinusoidal components in its spectrum must be such that all 
(or most) of the harmonic components will have one sign before the discontinuity and the opposite sign after the discontinuity. This will 
result in a sharp change in x(t) at the point of discontinuity. We can verify this fact in any waveform with jump discontinuity. Consider, 
for example, the sawtooth waveform in Fig. 6.6b. This waveform has a discontinuity at f = 1. The Fourier series for this waveform, as 
given in Exercise E6.1b, is 


Pi 


2A I ; I 
x(t) = cos (at 90°) + 5 cos (27t + 90°) + 3 00s (Gat -90°) 


1 
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Figure 6.8 shows the first three components of this series. The phases of all the (infinite) components are such that all the components 
are positive just before tf = 1 and turn negative just after t = 1, the point of discontinuity. The same behavior is also observed at t = —1, 
where a similar discontinuity occurs. This sign change in all the harmonics adds up to produce very nearly a jump discontinuity. The 
role of the phase spectrum is crucial in achieving a sharp change in the waveform. If we ignore the phase spectrum when trying to 
reconstruct this signal, the result will be a smeared and spread-out waveform. In general, the phase spectrum is just as crucial as the 
amplitude spectrum in determining the waveform. The synthesis of any signal x(t) is achieved by using a proper combination of 
amplitudes and phases of various sinusoids. This unique combination is the Fourier spectrum of x(t). 
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Figure 6.8: Role of the phase spectrum in shaping a periodic signal. 


FOURIER SYNTHESIS OF DISCONTINUOUS FUNCTIONS: THE GIBBS PHENOMENON 

Figure 6.7 showed the square function x(t) and its approximation by a truncated trigonometric Fourier series that includes only the first 
N harmonics for N = 1, 3, 5, and 19. The plot of the truncated series approximates closely the function x(t) as N increases, and we 
expect that the series will converge exactly to x(t) as N— o. Yet the curious fact, as seen from Fig. 6.7, is that even for large N, the 
truncated series exhibits an oscillatory behavior and an overshoot approaching a value of about 9% in the vicinity of the discontinuity at 


the nearest peak of oscillation. 1] Regardless of the value of N, the overshoot remains at about 9%. Such strange behavior certainly 
would undermine anyone's faith in the Fourier series. In fact, this behavior puzzled many scholars at the turn of the century. Josiah 
Willard Gibbs, an eminent mathematical physicist who was the inventor of vector analysis, gave a mathematical explanation of this 
behavior (now called the Gibbs phenomenon). 


We can reconcile the apparent aberration in the behavior of the Fourier series by observing from Fig. 6.7 that the frequency of 
oscillation of the synthesized signal is N fp, so the width of the spike with 9% overshoot is approximately 1/2Nfp. As we increase N, the 
frequency of oscillation increases and the spike width 1/2Nfp diminishes. As N — oo, the error power — O because the error consists 
mostly of the spikes, whose widths — 0. Therefore, as N — o, the corresponding Fourier series differs from x(t) by about 9% at the 
immediate left and right of the points of discontinuity, and yet the error power — 0. The reason for all this confusion is that in this case, 
the Fourier series converges in the mean. When this happens, all we promise is that the error energy (over one period) — 0 as N > 
oo. Thus, the series may differ from x(t) at some points and yet have the error signal power zero, as verified earlier. Note that the 
series, in this case also converges pointwise at all points except the points of discontinuity. It is precisely at the discontinuities that the 


series differs from x(t) by 9% [T] 
When we use only the first N terms in the Fourier series to synthesize a signal, we are abruptly terminating the series, giving a unit 


weight to the first N harmonics and zero weight to all the remaining harmonics beyond N. This abrupt termination of the series causes 
the Gibbs phenomenon in synthesis of discontinuous functions. Section 7.8 offers more discussion on the Gibbs phenomenon, its 


ramifications, and cure. 


The Gibbs phenomenon is present only when there is a jump discontinuity in x(t). When a continuous function x(t) is synthesized by 
using the first N terms of the Fourier series, the synthesized function approaches x(t) for all tas N — co. No Gibbs phenomenon 
appears. This can be seen in Fig. 6.9, which shows one cycle of a continuous periodic signal being synthesized from the first 19 
harmonics. Compare the similar situation for a discontinuous signal in Fig. 6.7. 


‘—- 


Figure 6.9: Fourier synthesis of a continuous signal using first 19 harmonics. 


EXERCISE E6.3 


By inspection of signals in Figs. 6.2a, 6.6a, and 6.6b, determine the asymptotic rate of decay of their 9 
amplitude spectra. - 


Answers 


1/n, q/n?, and 1/n, respectively. 


COMPUTER EXAMPLE C6.2 
Analogous to Fig. 6.7, demonstrate the synthesis of the square wave of Fig. 6.5a by successively adding its Fourier components. 


>>x = inline ('mod(t+pi/2,2*pi)< =pi'); t = linspace (-2*pi, 2*pi,1000); 
>>sumterms = zeros(16, length(t)); sumterms(1,:) = 1/2; 

>>for n = 1:size(sumterms,1)-1; 

>>sumterms(n+1,:) = (2/(pi*n)*sin(pi*n/2))*cos(n*t) ; 

>>en 

>>x N = cumsum (sumterms); figure(1); clf; ind = 0; 

>>for N = [0,1:2:size(sumterms, 1)-1], 

>>ind = ind+l; subplot (3,3,ind); 

>>plot (t,x N(N+1),:), 'k',t,x(t), 'k--'); axis ([-2*pi 2*pi -0.2 1.2]); 
>>xlabel ('t'); ylabel (['x {',num2str (N),'} (t)']); 

>>end = 
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Figure C6.2 
A HISTORICAL NOTE ON THE GIBBS PHENOMENON 
Normally speaking, troublesome functions with strange behavior are invented by mathematicians; we rarely see such oddities in 
practice. In the case of the Gibbs phenomenon, however, the tables were turned. A rather puzzling behavior was observed in a 
mundane object, a mechanical wave synthesizer, and then well-known mathematicians of the day were dispatched on the scent of it to 
discover its hideout. 


Albert Michelson (of Michelson-Morley fame) was an intense, practical man who developed ingenious physical instruments of 


extraordinary precision, mostly in the field of optics. His harmonic analyzer, developed in 1898, could compute the first 80 coefficients of 
the Fourier series of a signal x(t) specified by any graphical description. The instrument could also be used as a harmonic synthesizer, 
which could plot a function x(t) generated by summing the first 80 harmonics (Fourier components) of arbitrary amplitudes and phases. 
This analyzer, therefore, had the ability of self-checking its operation by analyzing a signal x(t) and then adding the resulting 80 
components to see whether the sum yielded a close approximation of x(t). 

Michelson found that the instrument checked very well with most of signals analyzed. However, when he tried a discontinuous function, 


such as a square wave,|T] a curious behavior was observed. The sum of 80 components showed oscillatory behavior (ringing), with an 
overshoot of 9% in the vicinity of the points of discontinuity. Moreover, this behavior was a constant feature regardless of the number of 
terms added. A larger number of terms made the oscillations proportionately faster, but regardless of the number of terms added, the 
overshoot remained 9%. This puzzling behavior caused Michelson to suspect some mechanical defect in his synthesizer. He wrote 
about his observation in a letter to Nature (December 1898). Josiah Willard Gibbs, who was a professor at Yale, investigated and 


clarified this behavior for a sawtooth periodic signal in a letter to Nature.!”] Later, in 1906, Bécher generalized the result for any function 


with discontinuity. [8] It was Bécher who gave the name Gibbs phenomenon to this behavior. Gibbs showed that the peculiar behavior in 
the synthesis of a square wave was inherent in the behavior of the Fourier series because of nonuniform convergence at the points of 
discontinuity. 


This, however, is not the end of the story. Both Bécher and Gibbs were under the impression that this property had remained 
undiscovered until Gibbs's work published in 1899. It is now known that what is called the Gibbs phenomenon had been observed in 
1848 by Wilbraham of Trinity College, Cambridge, who clearly saw the behavior of the sum of the Fourier series components in the 


periodic sawtooth signal later investigated by Gibbs.!¥1 Apparently, this work was not known to most people, including Gibbs and 
Bocher. 


[t]The reason for calling this behavior "convergence in the mean" is that minimizing the error energy over a certain interval is 
equivalent to minimizing the mean-squared value of the error over the same interval. 


[6]Guillemin, E. A. Theory of Linear Physical Systems. Wiley, New York, 1963. 
[tOr, to keep up with times, "the man behind a successful woman". 
[t]There is also an undershoot of 9% at the other side [at t = (11/2)*] of the discontinuity. 


[t]Actually, at discontinuities, the series converges to a value midway between the values on either side of the discontinuity. The 9% 
overshoot occurs at t = (11/2)” and 9% undershoot occurs at f = (11/2). 


[t]Actually it was a periodic sawtooth signal. 
[7]Gibbs, W. J. Nature, vol. 59, p. 606, April 1899. 
[8]B6cher, M. Annals of Mathematics, vol. 7, no. 2, 1906. 


[29]Carslaw, H. S. Bulletin of the American Mathematical Society, vol. 31, pp. 420-424, October 1925. 


6.3 EXPONENTIAL FOURIER SERIES 


: . . . . ei 235410 
By using Euler's equality, we can express cos nWoft and sin nWoft in terms of exponentials et and e/"™'t. Clearly, we should be 


able to express the trigonometric Fourier series in Eq. (6.9) in terms of exponentials of the form e/NWot with the index n taking on all 
integer values from — oo to o, including zero. Derivation of the exponential Fourier series from the results already derived for the 
trigonometric Fourier series is straightforward, involving conversion of sinusoids to exponentials. We shall, however, derive them here 
independently, without using the prior results of the trigonometric series. 


This discussion shows that the exponential Fourier series for a periodic signal x(t) can be expressed as 
oo 
x(t) = s De" 
ma=—Oo 
To derive the coefficients D,, we multiply both sides of this equation by e—Imurgt (m integer) and integrate over one period. This yields 


OD 
| x(pe jmexnt dt= ie v, | ei mM )aot dt (6.27) 
to Ty 


a oo 


Here we use the orthogonality property of exponentials (proved in the footnote below)!T] 
[ einse! g- iment qy {2 MFM (6.28) 
To To m=n 
Using this result in Eq. (6.27), we obtain 


Dah = [ x(t)e2""' dt 
Th 


from which we obtain 


| 
ss =; / x(t)e 2" dt. 
Ty Jt 


To summarize, the exponential Fourier series can be expressed as 


~ 
x(t) = > Dei"! (6.29a) 
where 
1 : 
Dp = — | x(t)e"™ dt (6.29b) 
To Ta 


Observe the compactness of expressions (6.29a) and (6.29b) and compare them with expressions corresponding to the trigonometric 
Fourier series. These two equations demonstrate very clearly the principal virtue of the exponential Fourier series. First, the form of the 
series is most compact. Second, the mathematical expression for deriving the coefficients of the series is also compact. It is much more 
convenient to handle the exponential series than the trigonometric one. For this reason we shall use exponential (rather than 
trigonometric) representation of signals in the rest of the book. 


We can now relate D,, to trigonometric series coefficients a, and by. Setting n = 0 in Eq. (6.29b), we obtain 


Do = a (6.30a) 


Moreover, for n + 0 


I j | 
Da, = [ x(t) cosnayt dt — all x(t) sin nat dt = 5 (as — jb.) (6.30b) 
0 Ji - 


Ts Sn 


and 


1 I 
D.=— | Xf) cos nat dt + jd x(f) sinnawt dt = = (a, + jb.) (6.30¢) 
To te To To 2 


These results are valid for general x(t), real or complex. When x(t) is real, a, and b, are real, and Eqs. (6.30b) and (6.30c) show that 
D, and D_, are conjugates. 


D_, =D! (6.31) 
Moreover, from Eqs. (6.13), we observe that 
dy — jb, = yfa2 +b? ef (SE) = Cyei™ 


Hence 
Do = 4 = Co (6.32a) 
and 
D,=1C,e%  D_,~=4C,e-™* (6.32b) 
Therefore 
Dal =|D_»| =4C, 20 (6.33a) 
LD, = 9p LD_» = —O, (6.33b) 


Note that |D,,| are the amplitudes and 2D, are the angles of various exponential components. From Eqs. (6.33) it follows that when x(t) 


is real, the amplitude spectrum (|D,| versus w) is an even function of w and the angle spectrum (2D, versus w) is an odd function of 
uw. For complex x(t), D, and D_, are generally not conjugates. 


EXAMPLE 6.5 
Find the exponential Fourier series for the signal in Fig. 6.2a (Example 6.1). 


In this case Tg = TI, Wo = 2Tt/To = 2, and 


x 
x(t) = > Dei" 


a=-—oo 


where 


Dy, 


i ; 
— | x(tei™ dt 
To To 


1 ped 


e 12» jin dt 


l 
- / 
e (1/2+j2n)t dt 


x 
-1 (1/2+ j2nt 
7 (5 + j2n) 0 
0.504 


1+ j4n 6.34) 


and 


x 
l 


x(t) = 0.504 p & 1+jan* 


aS 


Jans (6.35a) 


1 
2 4. 
ei” jt 


J 
1+j4 i+]8 1+jl2° 


= 0.504 i + 


em + e™ 


is 1—j8 *T-71 


et + | (6.35b) 
Observe that the coefficients D, are complex. Moreover, D, and D_, are conjugates, as expected. 


COMPUTER EXAMPLE C6.3 
Following Example 6.5, compute and plot the exponential Fourier spectra for the periodic signal x(t) shown in Fig. 6.2a. 


The expression for D, is derived in Example 6.5. 


>> n = (-10:10); Din = 0.504./ (1+3*4*n) ; 
>> clf; subplot (2,1,1); stem(n,abs(D_n),'k"'); 
>> xlabel('n'); ylabel ('|D_n|'); 


>> subplot (2,1,2); stem(n,angle(D_n),'k"'); 
>> xlabel ('n'); ylabel('\angle Dn [rad]'); 
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Figure C6.3 


6.3-1 Exponential Fourier Spectra 


In exponential spectra, we plot coefficients D, as a function of w. But since D, is complex in general, we need both parts of one of two 
sets of plots: the real and the imaginary parts of D,, or the magnitude and the angle of D,. We prefer the latter because of its close 
connection to the amplitudes and phases of corresponding components of the trigonometric Fourier series. We therefore plot |D,| 


versus W and 2D, versus w. This requires that the coefficients D, be expressed in polar form as |Dnjle<2n, where |D,| are the 
amplitudes and 2D, are the angles of various exponential components. Equations (6.33) show that for real x(t), the amplitude spectrum 
(|D,| versus w) is an even function of w and the angle spectrum (wD, versus w) is an odd function of w. 


For the series in Example 6.5 [Eq. (6.35b)], for instance, 
Dy = 0.504 


0.504 


= 0.122e° 799° => |[D,|=0.122, ZD, = —75.96 


0.504 - 
D.,= a = 0.122e/*°° — > |D_,|=0.122, £D_, = 75.96" 
and 

0.5 oe 
D, = a i 0.0625e°/***" => |D,| = 0.0625, 2D, = —82.87' 
D_»= -= = 0.0625e/5" — > |D_,|= 0.0625, £D_, = 82.87° 


and so on. Note that D, and D_, are conjugates, as expected [see Eqs. (6.33)]. 


Figure 6.10 shows the frequency spectra (amplitude and angle) of the exponential Fourier series for the periodic signal x(t) in Fig. 6.2a. 
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Figure 6.10: Exponential Fourier spectra for the signal in Fig. 6.2a. 


We notice some interesting features of these spectra. First, the spectra exist for positive as well as negative values of w (the 
frequency). Second, the amplitude spectrum is an even function of w and the angle spectrum is an odd function of w. 


At times it may appear that the phase spectrum of a real periodic signal fails to satisfy the odd symmetry: for example, when D, = D_, 


= —10. In this case, D, = 10e/”, and therefore, D_,; = 10e /. Recall that e/” = —1. Here, although D, = D_,, their phases should be 
taken as TT and —Tr. 


WHAT IS A NEGATIVE FREQUENCY? 

The existence of the spectrum at negative frequencies is somewhat disturbing because, by definition, the frequency (number of 
repetitions per second) is a positive quantity. How do we interpret a negative frequency? We can use a trigonometric identity to express 
a sinusoid of a negative frequency —Wo as 

COs (—Wol + 4) = cos (ot — A) 

This equation clearly shows that the frequency of a sinusoid cos(Wot + 8) is |wWo|, which is a positive quantity. The same conclusion is 
reached by observing that 

ets! — cos aot + j sin wot 


Thus, the frequency of exponentials e4/0 tis indeed |Wo|. How do we then interpret the spectral plots for negative values of w? A 


more satisfying way of looking at the situation is to say that exponential spectra are a graphical representation of coefficients Dp, as a 
function of w. Existence of the spectrum at w = —nWg is merely an indication that an exponential component e INWot exists in the 


series. We know that a sinusoid of frequency nWo can be expressed in terms of a pair of exponentials e/nWot and eo, 


We see a close connection between the exponential spectra in Fig. 6.10 and the spectra of the corresponding trigonometric Fourier 
series for x(t) (Fig. 6.2b, 6.2c). Equations (6.33) explain the reason for close connection, for real x(t), between the trigonometric spectra 
(C, and Z,,) with exponential spectra (|D,| and 2D,). The dc components Do and Cg are identical in both spectra. Moreover, the 
exponential amplitude spectrum |D,| is half the trigonometric amplitude spectrum C, for n = 1. The exponential angle spectrum 2 Dp is 
identical to the trigonometric phase spectrum 6, for n = 0. We can therefore produce the exponential spectra merely by inspection of 
trigonometric spectra, and vice versa. The following example demonstrates this feature. 


EXAMPLE 6.6 


The trigonometric Fourier spectra of a certain periodic signal x(t) are shown in Fig. 6.11a. By inspecting these spectra, sketch the 
corresponding exponential Fourier spectra and verify your results analytically. 
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Figure 6.11 


The trigonometric spectral components exist at frequencies 0, 3, 6, and 9. The exponential spectral components exist at 0, 3, 6, 9, and 
—3, —6, —9. Consider first the amplitude spectrum. The dc component remains unchanged: that is, Dp = Cg = 16. Now |D,| is an even 
function of w and |D,| = |D_,| = Cp/2. Thus, all the remaining spectrum |D,| for positive n is half the trigonometric amplitude spectrum 
Cp, and the spectrum |Dy| for negative n is a reflection about the vertical axis of the spectrum for positive n, as shown in Fig. 6.11b. 


The angle spectrum 2D, = 9, for positive n and is —8, for negative n, as depicted in Fig. 6.11b. We shall now verify that both sets of 
spectra represent the same signal. 


Signal x(t), whose trigonometric spectra are shown in Fig. 6.11a, has four spectral components of frequencies 0, 3, 6, and 9. The dc 
component is 16. The amplitude and the phase of the component of frequency 3 are 12 and —Tr/4, respectively. Therefore, this 
component can be expressed as 12 cos (3t¢ — 11/4). Proceeding in this manner, we can write the Fourier series for x(t) as 


x(t) = 16 + 12 cos | 31 + 8cos | 6f +4cos | 91 ad 
; = 2¢ 71 c = co 4 


“- 


Consider now the exponential spectra in Fig. 6.11b. They contain components of frequencies 0 (dc), +3, +6, and +9. The dc component 
is Do = 16. The component efst (frequency 3) has magnitude 6 and angle —11/4. Therefore, this component strength is 6e/74 and it can 


be expressed as (6e PT) @/3t. Similarly, the component of frequency —3 is (6e!7™4)e It. Proceeding in this manner, 4 (1) the signal 
corresponding to the spectra in Fig. 6.11b, is . 
£(t) = 16 + [6e7*4e™ + Gel*4e-I™) + [de eI® + heit/2e-I®) 


—jx/459 jn/4 —} 
+ [2e7F Fe! 4 2eit/4e- I") 
— 16+ 6[e/ + e71-2/9) + 4[ef@-#/ + e7 i t—2/2)) 


| 
4 
+ 2[e7™ ~m/4) +¢ j(t- =) 


16 + 120s (34 4) + 8e s (61 =) + 4cos ( ) 
_ 4+ 12 3tf—-—] + 0: —— —-—— 
4 2 4 


Clearly both sets of spectra represent the same periodic signal. 


BANDWIDTH OF A SIGNAL 

The difference between the highest and the lowest frequencies of the spectral components of a signal is the bandwidth of the signal. 
The bandwidth of the signal whose exponential spectra are shown in Fig. 6.11b is 9 (in radians). The highest and lowest frequencies 
are 9 and 0, respectively. Note that the component of frequency 12 has zero amplitude and is nonexistent. Moreover, the lowest 
frequency is 0, not —9. Recall that the frequencies (in the conventional sense) of the spectral components at ~ = —3, —6, and —9 in 


reality are 3, 6, and 9.[t] The bandwidth can be more readily seen from the trigonometric spectra in Fig. 6.11a. 


EXAMPLE 6.7 
Find the exponential Fourier series and sketch the corresponding spectra for the impulse train 57¢(t) depicted in Fig. 6.12a. From this 
result sketch the trigonometric spectrum and write the trigonometric Fourier series for 579(t). 


fa 


T, ove 
0 ony Jey, Son, fox Ser, co on 


tc 


Figure 6.12: (a) Impulse train and (b, c) its Fourier spectra. 


The unit impulse train shown in Fig. 6.12a can be expressed as 
fe, a] 


So b(t = nT) 


na=—OO 


Following Papoulis, we shall denote this function as 579(t) for the sake of notational brevity. 


The exponential Fourier series is given by 


a~ ; 2 
b(t)= >> Dre™ = oy = — (6.36) 
where 
l sans 
D, =— | dn(t)e-"™" dt 
To Jt 


Choosing the interval of integration (— To/2, To/2) and recognizing that over this interval 579(t) = 8(¢), 
D, = val d(t)e"™™ dt 
To J-t/2 


In this integral the impulse is located at tf = 0. From the sampling property (1.24a), the integral on the right-hand side is the value of 
e /nw0 t at t = 0 (where the impulse is located). Therefore 


1 
Dy = = (6.37) 
Tp 
Substitution of this value in Eq. (6.36) yields the desired exponential Fourier series 
Ec 2x 
5,,(t) = — enw = (6.38) 
° Ty » oT 


noa—0o 


Equation (6.37) shows that the exponential spectrum is uniform (D,=1/Tg) for all the frequencies, as shown in Fig. 6.12b. The 
spectrum, being real, requires only the amplitude plot. All phases are zero. 


To sketch the trigonometric spectrum, we use Eq. (6.33) to obtain 


G =D —_——_— 

0 0 7 

C, = 2|D,|= — n = 1,2,3, 
To 

6.=0 


Figure 6.12c shows the trigonometric Fourier spectrum. From this spectrum we can express 85To(t) as 


| 2x 
5, (t) = i [1 + 2(cos aayt + COS Zeyt + COS Bayt +-++)] @ = i (6.39) 
6 o 


EFFECT OF SYMMETRY IN EXPONENTIAL FOURIER SERIES 

When x(t) has an even symmetry, 6,=0, and from Eq. (6.30b), Dj=a,/2, which is real (positive or negative). Hence, 2D, can only be 0 
or ttt. Moreover, we may compute D,=a,/2 by using Eq. (6.18b), which requires integration over a half-period only. Similarly, when 
x(t) has an odd symmetry, a,=0, and D,=—jb,/2 is imaginary (positive or negative). Hence, 2D, can only be O or +11/2. Moreover, we 
may compute D,=//b,/2 by using Eq. (6.19b), which requires integration over a half-period only. Note, however, that in the exponential 
case, we are using the symmetry property indirectly by finding the trigonometric coefficients. We cannot apply it directly to Eq. (6.29b). 


EXERCISE E6.4 


The exponential Fourier spectra of a certain periodic signal x(t) are shown in Fig. 6.13. Determine and BF 
sketch the trigonometric Fourier spectra of x(t) by inspection of Fig. 6.13. Now write the (compact) - 
trigonometric Fourier series for x(t). 
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Figure 6.13 


Answers 


ww rs rT 
x(t) = 4+ 6cos (3: = *) + 2cos (or ~ *) +4cos (s - =) 


EXERCISE E6.5 


Find the exponential Fourier series and sketch the corresponding Fourier spectrum D, versus w for the full- BF 
wave rectified sine wave depicted in Fig. 6.14. - 


x(t) isin f 


20 7 0 7 2a i> 
Figure 6.14 
Answers 
= l 
» 2nt 
x(t) = — . 
> 1—4n? 
n=—oO 
EXERCISE E6.6 
Find the exponential Fourier series and sketch the corresponding Fourier spectra for the periodic signals af 


shown in Fig. 6.6. 


Answers 


6.3-2 Parseval's Theorem 

The trigonometric Fourier series of a periodic signal x(t) is given by 
oo 

x(t) =Cot+ a Cy COS (N@pt + I) 


Every term on the right-hand side of this equation is a power signal. As shown in Example 1.2, Eq. (1.4d), the power of x(t) is equal to 
the sum of the powers of all the sinusoidal components on the right-hand side. 


] ~w 
_ 2 2 
P, = Co* + 5 ) : Cs (6.40) 


The result is one form of the Parseval's theorem, as applied to power signals. It states that the power of a periodic signal is equal to the 
sum of the powers of its Fourier components. 


We can apply the same argument to the exponential Fourier series (see Prob. 1.1-8). The power of a periodic signal x(t) can be 


expressed as a sum of the powers of its exponential components. In Eq. (1.4e), we showed that the power of an exponential Del t is 


|D?|. We can use this result to express the power of a periodic signal x t) in terms; of its exponential Fourier series coefficients as 


oO 
P,= >| ID,/ (6.41a) 


a>—co 


For a real (t), |D_p|=|D,|. Therefore 


w 
P, = Do? +25> |D,l? (6.41b) 
n=l 
EXAMPLE 6.8 ; 
The input signal to an audio amplifier of gain 100 is given by x (f)=0.1 cos Wot. Hence, the output is a sinusoid 10 cos Wot. However, 


the amplifier, being nonlinear at higher amplitude levels, clips all amplitudes beyond +8 volts as shown in Fig. 6.15a. We shall determine 
the harmonic distortion incurred in this operation. 
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10 cos ey ~ 8 y,(0 


0.3976T, 


= 
10 cos et + 8 O.1024T,, 10 cos ont + 8 , 


ib) 
Figure 6.15: (a) A clipped sinusoid cos. Wot (b) The distortion component xQ(t) of the signal in (a). 


The output y(t) is the clipped signal in Fig. 6.15a. The distortion signal y,g(t), shown in Fig. 6.15b, is the difference between the 
undistorted sinusoid 10 cos Wot and the output signal y(t). The signal yg(t), whose period is Tg [the same as that of y(t) can be 
described over the first cycle as 
10 cos wot —8 \f| < 0.10247) 
Th Th 
Yat) = 4 10 cos apt +8 = — 0.10247) < |t| < or + 0.10247; 


0 everywhere else 
Observe that y,(t) is an even function of f and its mean value is zero. Hence, ag=Cg=0, and b,=0. Thus, C,;=a, and the Fourier series 
for yg(t) can be expressed as 

oO 


Yat) = ~ C,, COS NWot 


a=1 


As usual, we can compute the coefficients C,, (which is equal to a,,) by integrating yg (t) cos nt over one cycle (and then dividing by 


2/To). Because yg (t) has even symmetry, we can find a, by integrating the expression over a half-cycle only using Eq. (6.18b). The 


straightforward evaluation of the appropriate integral yields!T] 


20 | sin [0.6435(n + 1)] — sin[0.6435(n — 1)] 32 [sin (0.6435n) dd 
cmp | scumsemenseeinnansy ie ausstenpeneernmmanns | <n sins | qenetenemmnweant n ok 
C,m {7 an+1 ae | x | n 


0 n even 


Computing the coefficients C;C2C3,... from this expression, we can write 
ya(t) = 1.04cos mot + 0.733 cos 3am t + 0.311 cos Sat + --- 


COMPUTING HARMONIC DISTORTION 


We can compute the amount of harmonic distortion in the output signal by computing the power of the distortion component y(t). 
Because Y(t) is an even function of tf and because the energy in the first half-cycle is identical to the energy in the second half-cycle, 
we can compute the power by averaging the energy over a quarter-cycle. Thus 


1 /2 | | Tp/4 . 
P, -7/ y, ar= a | yu"(t) dt 
Ty J-ty)2' : Te/4Jo °° 


4 ). 10247) 
==> (10 cos wot — 8)* dt = 0.865 
To 0 
The power of the desired signal 10 cos Wof is (10)2/2=50. Hence, the total harmonic distortion is 
0.865 
Dron = —— x 100 = 1.73% 
50 
The power of the third harmonic components of yy(t) is (0.733)?/2=0.2686. The third harmonic distortion is!+ 
0.2686 
dD; = 50, x 100 = 0.5372% 


[tlWe can readily prove this property as follows. For the case of m = n, the integrand in Eq. (6.28) is unity and the integral is To. When 
m # n, the integral on the left-hand side of Eq. (6.28) can be expressed as 


/ ef B-Mn! dt = | cos (n — m)wot dt + if sin (n — m)wot dt 
Tp Ta To 


Both the integrals on the right-hand side represent area under n — m number of cycles. Because n — mis an integer, both the areas 
are zero. Hence follows Eq. (6.28). 


[tlSome authors do define bandwidth as the difference between the highest and the lowest (negative) frequency in the exponential 
spectrum. The bandwidth according to this definition is twice that defined here. In reality, this phrasing defines not the signal bandwidth 
but the spectral width (width of the exponential spectrum of the signal). 


[t]in addition, Yq(t) exhibits half-wave symmetry (see Prob. 6.1-5), where the second half-cycle is the negative of the first. Because of 


this property, all the even harmonics vanish, and the odd harmonics can be computed by integrating the appropriate expressions over 
the first half-cycle only (from — To/4 to To/4) and doubling the resulting values. Moreover, because of even symmetry, we can integrate 


the appropriate expressions over 0 to 7/4 (instead of from /To/4 to To/4) and double the resulting values. In essence, this allows us to 
compute C, integrating the expression over the quarter-cycle only and then quadrupling the resulting values. Thus 


10247; 
8 0 


To 0 


~ 


C, =a, = [10 cos apt — 8] cos nat dt 


[t]in the literature, the harmonic distortion often refers to the rms distortion rather than the power distortion. The rms values are the 


square-root values of the corresponding powers. Thus, the third harmonic distortion in this sense is V(0.2086/50) x 100 = 7.33%, 
Alternately, we may also compute this value directly from the amplitudes of the third harmonic 0.733 and that of the fundamental as 10. 
The ratio of the rms values is (0.733/./2). (10/./2) = 0.0733 and the percentage distortion is 7.33%. 


6.4 LTIC SYSTEM RESPONSE TO PERIODIC INPUTS 


A periodic signal can be expressed as a sum of everlasting exponentials (or sinusoids). We also know how to find the response of an 


LTIC system to an everlasting exponential. From this information we can readily determine the response of an LTIC system to periodic 
inputs. A periodic signal x(t) with period Tg can be expressed as an exponential Fourier series 
ao 


2 
x(t)= , D,e/"™ W TT 


— 
Ii=—ooO 1p 


In Section 4.8, we showed that the response of an LTIC system with transfer function H(s) to an everlasting exponential input elt is an 
everlasting exponential H(jw)e!“*. This input-output pair can be displayed as!T] 

ce" = > H(jw)e’™ 

—~—— ——< 

input output 


Therefore, from the linearity property 


oo oo 
>> De => S° D,H(jnay)ei* (6.42) 
fa—oO R=—-XO 
a so 

inpul xi) response vil) 


The response y (f) is obtained in the form of an exponential Fourier series and is therefore a periodic signal of the same period as that 
of the input. 


We shall demonstrate the utility of these results by the following example. 


EXAMPLE 6.9 BS BS _ ; oe 
A full-wave rectifier (Fig. 6.16a) is used to obtain a dc signal from a sinusoid sin f. The rectified signal x(t), depicted in Fig. 6.14, is 
applied to the input of a lowpass RC filter, which suppresses the time-varying component and yields a dc component with some 
residual ripple. Find the filter output y(t). Find also the dc output and the rms value of the ripple voltage. 


isd 


foctifier 
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+ Full-wave 
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» 
Figure 6.16: (a) Full-wave rectifier with a lowpass filter and (b) its output. 


First, we shall find the Fourier series for the rectified signal x(t), whose period is Tg=T Consequently, w=2, and 


ra) 
x(t) per > D,e/™ 


where 
D i int e~?™ dt : (6.43) 
=— s dt = ————— AB 
* #6 m(1 —4n?) 
Therefore 
9 
» {1 — 4n?) 


a=—coo 


Next, we find the transfer function of the RC filter in Fig. 6.16a. This filter is identical to the RC circuit in Example 1.11 (Fig. 1.35) for 
which the differential equation relating the output(capacitor voltage) to the input x(t) was found to be [Eq. (1.60)] 


(3D + y(t) = x(t) 
The transfer function H(s) for this system is found from Eq. (2.50) as 


| 
H(s) = ——— 
(s) 3s +1 


and 


i 
fig -——— 6.44 
I slo + 1 eA) 


From Eq. (6.42), the filter output y(t) can be expressed as (with w 0=2) 
~ foe) 
y(t)= $> D,H(jnay)e™! = S~ D,H(j2n)ei™ 


a=—oO n=——oo 


Substituting D, and H(j2n) from Eqs. (6.43) and (6.44) in the foregoing equation, we obtain 


ao 4 
y(t) = ar ae (6.45) 
ee m(1 — 4n*)(j6n + 1) 
Note that the output y(t) is also a periodic signal given by the exponential Fourier series on the right-hand side. The output is 
numerically computed from Eq. (6.45) and plotted in Fig. 6.16b. 


The output Fourier series coefficient corresponding to n=0 is the dc component of the output, given by 2/1. The remaining terms in the 
Fourier series constitute the unwanted component called the ripple. We can determine the rms value of the ripple voltage by using Eq. 
(6.41) to find the power of the ripple component. The power of the ripple is the power of all the components except the dc (n=0). Note 


that Dn, the exponential Fourier coefficient for the output y(f) is 
9 


~ — 


Dy 


~ 3e(1 — 4n2)(j6n + 1) 
Therefore, from Eq. (6.41b), we have 


, 2 Po se 1 
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&+ | x(1 — 4n*)(j6n + 1) ™ 


x? 2 (1 — 4n?)*(36n? + 1) 


a=! 


Numerical computation of the right-hand side yields Prippje=0.0025, and the ripple rms value 'V Prippte = 0.05 This shows that the rms 
ripple voltage is 5% of the amplitude of the input sinusoid. 


WHY USE EXPONENTIALS? 


The exponential Fourier series is just another way of representing trigonometric Fourier series (or vice versa). The two forms carry 
identical information-no more no less. The reasons for preferring the exponential form have already been mentioned: this form is more 
compact, and the expression for deriving the exponential coefficients is also more compact, than those in the trigonometric series. 
Furthermore, the LTIC system response to exponential signals is also simpler (more compact) than the system response to sinusoids. In 
addition, the exponential form proves to be much easier than the trigonometric form to manipulate mathematically and otherwise handle 
in the area of signals as well as systems. Moreover, exponential representation proves much more convenient for analysis of complex 
x(t). For these reasons, in our future discussion we shall use the exponential form exclusively. 


A minor disadvantage of the exponential form is that it cannot be visualized as easily as sinusoids. For intuitive and qualitative 
understanding, the sinusoids have the edge over exponentials. Fortunately, this difficulty can be overcome readily because of the close 
connection between exponential and Fourier spectra. For the purpose of mathematical analysis, we shall continue to use exponential 
signals and spectra; but to understand the physical situation intuitively or qualitatively, we shall speak in terms of sinusoids and 
trigonometric spectra. Thus, although all mathematical manipulation will be in terms of exponential spectra, we shall now speak of 
exponential and sinusoids interchangeably when we discuss intuitive and qualitative insights in attempting to arrive at an understanding 
of physical situations. This is an important point; readers should make an extra effort to familiarize themselves with the two forms of 
spectra, their relationships, and their convertibility. 


DUAL PERSONALITY OF A SIGNAL 


The discussion so far shows that a periodic signal has a dual personality-the time domain and the frequency domain. It can be 
described by its waveform or by its Fourier spectra. The time and frequency-domain descriptions provide complementary insights into a 
signal. For in-depth perspective, we need to understand both these identities. It is important to learn to think of a signal from both 
perspectives. In the next chapter, we shall see that aperiodic signals also have this dual personality. Moreover, we shall show that even 
LTI systems have this dual personality, which offers complementary insights into the system behavior. 


LIMITATIONS OF THE FOURIER SERIES METHOD OF ANALYSIS 


We have developed here a method of representing a periodic signal as a weighted sum of everlasting exponentials whose frequencies 
lie along the jw axis in the s plane. This representation (Fourier series) is valuable in many applications. However, as a tool for 
analyzing linear systems, it has serious limitations and consequently has limited utility for the following reasons: 


1. The Fourier series can be used only for periodic inputs. All practical inputs are aperiodic (remember that a periodic signal 


starts at f=— 0). 


2. The Fourier methods can be applied readily to BIBO-stable (or asymptotically stable) systems. It cannot handle unstable 
or even marginally stable systems. 


The first limitation can be overcome by representing a periodic signals in terms of everlasting exponentials. This representation can be 
achieved through the Fourier integral, which may be considered to be an extension of the Fourier series. We shall therefore use the 
Fourier series as a stepping stone to the Fourier integral developed in the next chapter. The second limitation can be overcome by 


using exponentials e®’, where s is not restricted to the imaginary axis but is free to take on complex values. This generalization leads to 
the Laplace integral, discussed in Chapter 4 (the Laplace transform). 


[T]This result applies only to the asymptotically stable systems. This is because when s=/w, the integral on the right-hand side of Eq. 
(2.48) does not converge for unstable systems. Moreover, for marginally stable systems also, that integral does not converge in the 
ordinary sense, and H(jw) cannot be obtained from H(s) by replacing s with jw. 


6.5 GENERALIZED FOURIER SERIES: SIGNALS AS VECTORS?! 


We now consider a very general approach to signal representation with far-reaching consequences. There is a perfect analogy between 
signals and vectors; the analogy is so strong that the term analogy understates the reality. Signals are not just like vectors. Signals are 
vectors! A vector can be represented as a sum of its components in a variety of ways, depending on the choice of coordinate system. A 
signal can also be represented as a sum of its components in a variety of ways. Let us begin with some basic vector concepts and then 
apply these concepts to signals. 


6.5-1 Component of a Vector 


A vector is specified by its magnitude and its direction. We shall denote all vectors by boldface. For example, x is a certain vector with 
magnitude or length |x|. For the two vector x and y shown in Fig. 6.17, we define their dot (inner or scalar) product as 


X-y = |x|ly| cos 0 (6.46) 


cy y 


Figure 6.17: Component (projection) of a vector along another vector. 


where 8 is the angle between these vectors. Using this definition we can express |x|, the length of a vector x, as 


x? =x-x (6.47) 


Let the component of x along y be c y as depicted in Fig. 6.17. Geometrically, the component of x along y is the projection of x on y 
and is obtained by drawing a perpendicular from the tip of x on the vector y, as illustrated in Fig. 6.17. What is the mathematical 
significance of a component of a vector along another vector? As seen from Fig. 6.17, the vector x can be expressed in terms of vector 
y as 


x=cy+e (6.48) 
However, this is not the only way to express x in terms of y. From Fig. 6.18, which shows two of the infinite other possibilities, we have 


Xx=aqy+e,=—=Qy+e (6.49) 


ay 
(a) (b) 
Figure 6.18: Approximation of a vector in terms of another vector. 


In each of these three representations, x is represented in terms of y plus another vector called the error vector, If we approximate x by 
cy 
rey (6.50) 


the error in the approximation is the vector e=x — cy. Similarly, the errors in approximations in these drawing are e, (Fig. 6.18a) and 
@> (Fig. 6.18b). What is unique about the approximation in Fig. 6.17 is that the error vector is the smallest. We can now define 


mathematically the component of a vector x along vector y to be c y where c is chosen to minimize the length of the error vector 
e=x-—c y. Now, the length of the component of x along y is |x| cos 9. But its is also cly| as seen from Fig. 6.17. Therefore 
cly| = |x| cos 0 


Multiplying both sides by |y| yields 
2 Kine 
cly|” = |x|ly|cos @=x-y 


Therefore 


1 


ly|? 


x 
yo 
From Fig. 6.17, it is apparent that when x and y and are perpendicular, or orthogonal, then x has a zero component along y; 
consequently, c=0. Keeping an eye on Eq. (6.51), we therefore define x and y to be orthogonal if the inner (scalar or dot) product of the 
two vector is zero, that is, if 


x-y=0 (6.52) 


6.5-2 Signal Comparison and Component of a Signal 


The concept of a vector component and orthogonality can be extended to signals. Consider the problem of approximating a real signal 
x(t) in terms of another real signal y(t) over an interval (t4, t2): 


x(t) = cy(t) ih<t<h (6.53) 


The error e(f) in this approximation is 


x(t) —cy(t) h<t<h 
et) = (6.54) 


0 otherwise 


We now select a criterion for the "best approximation." We know that the signal energy is one possible measure of a signal size. For 
best approximation, we shall use the criterion that minimizes the size or energy of the error signal e(f) over the interval (t1, tz). This 


energy Eg is given by 


hh 
B= | e*(t)dt 


" 
fh 

=| [x(t) —cy(t)P at 
nh 


Note that the right-hand side is a definite integral with t as the dummy variable. Hence, E, is a function of the parameter c (not ft) and 
Eg is minimum for some choice of c. To minimize E,, a necessary condition is 


dE, _ 


0 55 
Ae (6.55) 


or 


d I 
ETT if [x(t) - yr ar] =( 
dc |. h 


Expanding the squared term inside the integral, we obtain 


r et: = d fy d 7 fy : 
g. | Pua -— ac / xy dt) +— le f yw = Q 
de Vr, dc h de ft 


From which we obtain 
i> fs 

-2 | x@y(at + 2c [ y(at=0 
h nh 


and 


f 
[ x(Oy(1) dt 
es 
| y(t)dt 
th 


We observe a remarkable similarity between the behavior of vectors and signals, as indicated by Eqs. (6.51) and (6.56). It is evident 
from these two parallel expressions that the area under the product of two signals corresponds to the inner (scalar or dot) product of 
two vectors. In fact, the area under the product of x(t) and y(t) is called the inner product of x(t) and y(t), and is denoted by (x, y). The 
energy of a signal is the inner product of a signal with itself, and corresponds to the vector length square (which is the inner product of 
the vector with itself). 


1 h 
t= -~/ x()y(1) dt (6.56) 
Fy “ 


To summarize our discussion, if a signal x(t) is approximated by another signal y(t) as 
x(t) = cy(t) 
then the optimum value of c that minimizes the energy of the error signal in this approximation is given by Eq. (6.56). 


Taking our clue from vectors, we say that a signal x(t) contains a component cy(t), where c is given by Eq. (6.56). Note that in vector 
terminology, cy(t) is the projection of x(t) on y(t). Continuing with the analogy, we say that if the component of a signal x(t) of the form 
y(t) is zero (i.e., c=0), the signals x(t) and y(t) are orthogonal over the interval (t,, to). Therefore, we define the real signals x(t) and 


y(t) to be orthogonal over the interval (f4, tz) iff 


12 
7 x(t)y(t)dt = 0 (6.57) 
fi 


EXAMPLE 6.10 


For the square signal x(t) shown in Fig. 6.19 find the component in x(t) of the form sin tf. In other words, approximate x(t) in terms of 
sin t 
x(t) ~ csint O<(<2n 


Figure 6.19: Approximation of a square signal in terms of a single sinusoid. 
so that the energy of the error signal is minimum. 


In this case 
ax 9 
y(t) = sint and E,= sin’(t)dt = 7 


From Eq. (6.56), we find 


ey we » 4 
i - | x(t)sint dt = — [/ sini dt + i sins di == (6.58) 
Jo a 0 . ig 


Thus 


4 
x(t) ~ —sint (6.59) 
ra 


represents the best approximation of x(t) by the function sin g which will minimize the error energy. This sinusoidal component of x(f) is 
shown shaded in Fig. 6.19. By analogy with vectors, we say that the square function x(t) depicted in Fig. 6.19 has a component of 
signal sin t and that the magnitude of this component is 4/Tr. 


EXERCISE E6.7 

Show that over an interval (—trt < ¢t < Tr), the "best" approximation of the signal x(f)=t in terms of the function sin tis 2 sin t. Verify that 
the error signal e(t)=t — 2 sin t is orthogonal to the signal sin ¢ over the interval —1r < t < Tr. Sketch the signals t and 2 sin t over the 
interval —T <f< Tr. 


6.5-3 Extension to Complex Signals 


So far we have restricted ourselves to real functions of t. To generalize the results to complex functions of t, consider again the problem 
of approximating a signal x(t) by a signal y(t) over an interval (ty < t < ft): 


x(t) = cy(t) (6.60) 


where x(t) and y(t) now can be complex functions of t. Recall that the energy Ey of the complex signal y(t) over an interval (t1, tz) is 


i> 
E,=[ ly(t)|? dt 


In this case, both the coefficient c and the error 
e(t) = x(t) —cy(f) (6.61) 


are complex (in general). For the "best" approximation, we choose c so that E,, the energy of the error signal e(t) is minimum. Now, 


fz 
E, = Ix(t) — cy(1)[? dt (6.62) 
fh 


Recall also that 


lu + vl = (a + vu +e") = Jul? + oP tate tv’ (6.63) 


After some as ie we can use Me result to rearrange Eq. (6. oe) as 


z= [ ix(Pdr— f x(t)y"(t) dt c/E, -e f x(Oy" (dt 
R rr ¥ 


Since the first two terms on the right-hand side are independent of c, it is clear that E, is minimized by choosing c so that the third term 
on the right-hand side is zero. This yields 


l ft 
c= =/ x(t)y"(t) di (6.64) 
Ey " 


In light of this result, we need to redefine orthogonality for the complex case as follows: two complex functions x4(t) and x(t) are 
orthogonal over an interval (f4 < t < t) if 


4 fy 
| xOx (dt =0 or / X}(Ox20) dt =0 (6.65) 
4 Jt 
Either equality suffices. This is a general definition of orthogonality, which reduces to Eq. (6.57) when the functions are real. 
EXERCISE E6.8 

Show that over an interval (0 < f < 2tr), the "best" approximation of the square signal x(t) in Fig. 6.19 in terms of the signal eltis given 
by (2/jtt)e/t. Verify that the error signal e(t)=x(t) — (2/jtt)e/ is orthogonal to the signal e/. 

ENERGY OF THE SUM OF ORTHOGONAL SIGNALS 


We know that the square of the length of a sum of two orthogonal vectors is equal to the sum of the squares of the lengths of the two 
vectors. Thus, if vectors x and y are orthogonal, and if z=x + y, then 


2 2 2 
|" = |x|" + ly| 


We have a similar result for signals. The energy of the sum of two orthogonal signals is equal to the sum of the energies of the two 


signals. Thus, if signals x(t) and y(t) are orthogonal over an interval (f4, fa), and if z(t)=x(t) + y(t), then 
E,=E, +E, (6.66) 


We now prove this result for complex signals of which real signals are a special case. From Eq. (6.63) it follows that 


ts t #3 fs i 
| x(t) + yinpar= [ winrar + [ innrar + f riovnars [cya 
i ty n ty f 
ty #3 - 
-/ jx(a)f de + | y(n de (6.67) 
fe nh 


The last result follows from the fact that because of orthogonality, the two integrals of the products x(t)y*(t) and x*(t)y(t) are zero [see 
Eq. (6.65)]. This result can be extended to the sum of any number of mutually orthogonal signals. 


6.5-4 Signal Representation by an Orthogonal Signal Set 


In this section we show a way of representing a signal as a sum of orthogonal signals. Here again we can benefit from the insight 
gained from a similar problem in vectors. We know that a vector can be represented as a sum of orthogonal vectors, which form the 
coordinate system of a vector space. The problem in signals is analogous, and the results for signals are parallel to those for vectors. 
So, let us review the case of vector representation. 


ORTHOGONAL VECTOR SPACE 

Let us investigate a three-dimensional Cartesian vector space described by three mutually orthogonal vectors x;, Xz, and x3, as 
illustrated in Fig. 6.20. First, we shall seek to approximate a three-dimensional vector x in terms of two mutually orthogonal vectors x4 
and x9: 

XX CiX1 + CoXo 


(1%) 1 €2X2 


Figure 6.20: Representation of a vector in three-dimensional space. 


The error e in this approximation is 
e = X — (CX) + C2X2) 


or 
KX = C1X; + CoX2.+e 


As in the earlier geometrical argument, we see from Fig 6.20 that the length of e is minimum when e is perpendicular to the x4-x2 
plane, and c1x 1 and cox are the projections (components) of x on x4 and x9, respectively. Therefore, the constants c1, and cz are 
given by Eq. (6.51). Observe that the error vector is orthogonal to both the vectors x4 and x9. 


Now, let us determine the "best" approximation to x in terms of all three mutually orthogonal vectors x4, x2, and x3: 
X  €yXy + CoXo + C3X3 (6.68) 
Figure 6.20 shows that a unique choice of cy, C2, and c3 exists, for which Eq. (6.68) is no longer an approximation but an equality 
MX = CX; + C2X2 + 3X3 (6.69) 
In this case, C4x1, C2X2, and C3x3 are the projections (components) of x on x41, X2, and x3, respectively; that is, 
X-X; 


= (6.70a) 
Xj X& 


= eX X; i=1,2,3 (6.70b) 


Note that the error in the approximation is zero when x is approximated in terms of three mutually orthogonal vectors: x1, x2, and x3. 
The reason is that x is a three-dimensional vector, and the vectors x;, Xz, and x3 represent a complete set of orthogonal vectors in 
three-dimensional space. Completeness here means that it is impossible to find another vector x4 in this space, which is orthogonal to 
all three vectors, x4, X2, and x3. Any vector in this space can then be represented (with zero error) in terms of these three vectors. 
Such vectors are known as basis vectors. If a set of vectors {x;} is not complete, the error in the approximation will generally not be 
zero. Thus, in the three-dimensional case discussed earlier, it is generally not possible to represent a vector x in terms of only two 
basis vectors without an error. 


The choice of basis vectors is not unique. In fact, a set of basis vectors corresponds to a particular choice of coordinate system. Thus, a 
three-dimensional vector x may be represented in many different ways, depending on the coordinate system used. 


ORTHOGONAL SIGNAL SPACE 

We start with real signals first and then extend the discussion to complex signals. We proceed with our signal approximation problem, 
using clues and insights developed for vector approximation. As before, we define orthogonality of a real signal set x(t), x(t), .... Xp(t) 
over interval (t1, fo) as 


W 0 ms~n 
| Xm(t)xX, (1) dt = (6.71) 
f; E,, m=n 


If the energies E,,=1 for all n, then the set is normalized and is called an orthonormal set. An orthogonal set can always be normalized 
by dividing x,(t) by VE, for all n. 


Now, consider approximating a signal x(t) over the interval (t,, ta) by a set of N real, mutually orthogonal signals x4(t), x2(f), .... xa(o) 
as 


XO) & Cyxy(f) + Coxall) +++ + Cwrn (1) (6.72a) 
N 

2 So cnXn(t) (6.72b) 
n=l 


In the approximation of Eqs. (6.72) the error e(t) is 
N 


e(t) = x(t) — > eX, (1) (6.73) 


n=! 


and Eg, the error signal energy is 


f; 
z= | e*(t)dt 
fT 


fy N . 
= x(t) — CnXn(t)| dt (6.74) 
[f |10- Yew 


According to our criterion for best approximation, we select the values of c; that minimize E,. 


Hence, the necessary condition is 0E,/dc;=0 for i=1, 2, ..., N, that is, 


a fe ~ ; 
ai 0 - Sant) di=0 (6.75) 


asl 
When we expand the integrand, we find that all the cross-multiplication terms arising from the orthogonal signals are zero by virtue of 
orthogonality: that is, all terms of the form $x,,(t)xp,(t) dt with m # n vanish. Similarly, the derivative with respect to c; of all terms that 
do not contain c; is zero. For each i, this leaves only two nonzero terms in Eq. (6.75): 


a Me > 94 
— [—2c,x(t)xi(t) + c:°xi7(t)] dt =0 
OC; h 


or 


is ty 
-2 [ xiox(ndt +24 | x(t)dt =0 i=1,2,...,N 
fh 
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Therefore 


#3 
| x(t)x (0) dt 
ui 


fy 
| x(t) dt 
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1 f® 
= z/ x(t)xi (dt i=1,2,...,N (6.76b) 


Gj = (6.76a) 


A comparison of Eqs. (6.76) with Eqs. (6.70) forcefully brings out the analogy of signals with vectors. 


Finality Property. Equation (6.76) shows one interesting property of the coefficients of Cc, Co, ..., Cry: the optimum value of any 
coefficient in approximation (6.72a) is independent of the number of terms used in the approximation. For example, if we used only one 
term (N=1) or two terms (N=2) or any number of terms, the optimum value of the coefficient c; would be the same [as given by Eq. 
(6.76)]. The advantage of this approximation of a signal x(t) by a set of mutually orthogonal signals is that we can continue to add terms 
to the approximation without disturbing the previous terms. This property of finality of the values of the coefficients is very important 


from a practical point of view.1] 
ENERGY OF THE ERROR SIGNAL 


When the coefficients c; in the approximation (6.72) are chosen according to Eqs. (6.76), the error signal energy in the approximation 
(6.72) is minimized. This minimum value of E, is given by Eq. (6.74): 


ty N 2 
E. = | 0 _ Yani) dt 
" n=l 
ts N ts N ts 
-/ rod+ oe [ x(t) dt -2)76, | x(t)x,(t) dt 
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Substitution of Eqs. (6.71) and (6.76) in this equation yields 


t N 
E.= | x(t) dt + x? - 2) cE, 
a | 


> N 
- | w(dt— > ek, (6.77) 
f al 


Observe that because the term c.2Ex is nonnegative, the error energy E, generally decreases as N, the number of terms, is increased. 
Hence, it is possible that the error energy — 0 as N — oo. When this happens, the orthogonal signal set is said to be complete. In this 
case, Eq. (6.72b) is no more an approximation but an equality 


X(t) = C,X, (0) + C2XQ(1) +--+ + OX, (I) + 
- > enka (t) h<t<h (6.78) 
nal 


where the coefficients c, are given by Eq. (6.76b). Because the error signal energy approaches zero, it follows that the energy of x(f) is 
now equal to the sum of the energies of its orthogonal components c1x7(t), Coxo(t), C3x3(t), ... 


The series on the right-hand side of Eq. (6.78) is called the generalized Fourier series of x(t) with respect to the set {x,(f)}. When the 
set {x,,(f)} is such that the error energy Ez — 0 as N — o for every member of some particular class, we say that the set {x,(t)} is 
complete on (f1, f2) for that class of x(t), and the set {x,,(f)} is called a set of basis functions or basis signals. Unless otherwise 
mentioned, in future we shall consider only the class of energy signals. 


Thus, when the set {x,,(f)} is complete, we have the equality (6.78). One subtle point that must be understood clearly is the meaning of 
equality in Eq. (6.78). The equality here is not an equality in the ordinary sense, but in the sense that the error energy, that is, the 
energy of the difference between the two sides of Eq. (6.78), approaches zero. lf the equality exists in the ordinary sense, the error 
energy is always zero, but the converse is not necessarily true. The error energy can approach zero even though e(f), the difference 
between the two sides, is nonzero at some isolated instants. The reason is that even if e(f) is nonzero at such instants, the area under 


e2(t) is still zero; thus the Fourier series on the right-hand side of Eq. (6.78) may differ from x(t) at a finite number of points. 


In Eq. (6.78), the energy of the left-hand side is E,, and the energy of the right-hand side is the sum of the energies of all the 
orthogonal components.!1] Thus 


fy 
j xr(tjdt = cE, +C3E2+->: 
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2 


E, (6.79) 


This is the Parseval's theorem applicable to energy signals. In Eqs. (6.40) and (6.41), we have already encountered the form of the 
Parseval theorem suitable for power signals. Recall that the signal energy (area under the squared value of a signal) is analogous to 
the square of the length of a vector in the vector-signal analogy. In vector space, we know that the square of the length of a vector is 
equal to the sum of the squares of the lengths of its orthogonal components. The Parseval theorem in Eq. (6.79) is the statement of this 
fact as it applies to signals. 


GENERALIZATION TO COMPLEX SIGNALS 
The foregoing results can be generalized to complex signals as follows: a set of functions x,(t), x(t), ..., x(t) is mutually orthogonal 


over the interval (t,, to) if 


i 0 
/ Xm (O)xi(t) dt = { , = (6.80) 
ts E, m=n 


If this set is complete for a certain class of functions, then a function x(t) in this class can be expressed as 


X(t) = C1411) + Co¥(1) e+ OA) Fe (6.81) 
where 
1 h 
C, = z/ x(x, (1) dt (6.82) 
E, Nn 


EXAMPLE 6.11 
As an example, we shall consider again the square signal x(t) in Fig. 6.19. In Example 6.10 this signal was approximated by a single 


sinusoid sin t. Actually the set sin f sin 2¢, ..., sin nt, ... is orthogonal over the interval over any interval of duration 211.[t] The reader 
can verify this fact by showing that for any real number a 


a+ lr 0 
| sin mf sin nidt = { eee (6.83) 
: w m=n 


Let us approximate the square signal in Fig. 6.19, using this set, and see how the approximation improves with number of terms 
x(t) ~ cy sin ¢ + c2 sin 24 +---+c¢, sin Ni 


where 
pe 
| x(t) sin nt dt 
Cn = 0 = 
[ sin? nt dt 
0 
1 = 2s 
=— if sin ni dt +/ —sin midi 
oe 0 n 
4 
— n odd 
=< mn (6.84) 
0 n even 
Therefore 


4 l l 1 
x(t) ~ —{ sint + — sin 3 + —sin 5t +---+—sin Ni (6.85) 
n 3 5 N 


Note that coefficients of terms sin kt are zero for even values of k. Figure 6.21 shows how the approximation improves as we increase 
the number of terms in the series. Let us investigate the error signal energy as N — o. Form Eq. (6.77) 


Dr oo 
E, = [ x(t)dt—J CE, 
0 


n=! 


x(t) 


Figure 6.21: Approximation of a square signal by a sum of sinusoids. 


Note that 
2x 7 2n 
[ x(t) dt =f dt +f —I?dt=2n 
0 0 x 
16 
n odd 
n 
0) n even 
and from Eq. (6.83) 
R= 
Therefore 
x 146 
E, =2x - BD mw 
259 
n=1,3,5, we 
N 
16 1 
-x-2 ys 
a=1,3.5.... 


For a single-term approximation (N=1), 


E, =2x — iS == 1.1938 
iT 


For a two-term approximation (N=3) 


16 1 
-=2x -— (1 + 5) = 0.6243 
a 9 


& 


Table 6.3 shows the error energy Eg for various values of N. 


Table 6.3 
= Open table as 
spreadsheet 


—s 
[1.1938 _| 


1.1938 


[ 0.6243 | 
[0.4206 | 
0.3166 | 
(0.02545 | 
[0 | 


Clearly, x(t) can be represented by the infinite series 


[wv ] 
[1] 
[3] 
rs | 
[7 ] 
[99 
Ex 


4 1 1 
x(t) = —| sint + = sin 3f + = sinSr +--- 
x 3 5 
4annil, 
=— 5 — sinat (6.86) 
Ww n 


a=13.5 


The equality exists in the sense that the error signal energy — 0 as N — o. In this case, the error energy decreases rather slowly with 
N, indicating that the series converges slowly. This is to be expected because x(t) has jump discontinuities and consequently, according 
to discussion in Section 6.2-2, the series converges asymptotically as 1/n. 


EXERCISE E6.9 


Approximate the signal x(t)=t — Tr (Fig. 6.22) over the interval (0, 2p) in terms of the set of sinusoids {sin né}, 9 
n=0, 1, 2, ..., used in Example 6.11. Find Eg, the error energy. Show that E, - 0 asN — ow. ' 


x) 7+ 


maT 


Figure 6.22 
Answers 
N N 
24 4x 
x(t) ~ —2 —sin nt and E,e=-m° - — 
d N : 3 n=l n? 


SOME EXAMPLES OF GENERALIZED FOURIER SERIES 

Signals are vectors in every sense. Like a vector, a signal can be represented as a sum of its components in a variety of ways. Just as 
vector coordinate systems are formed by mutually orthogonal vectors (rectangular, cylindrical, spherical), we also have signal coordinate 
systems (basis signals) formed by a variety of sets of mutually orthogonal signals. There exist a large number of orthogonal signal sets 
that can be used as basis signals for generalized Fourier series. Some well-known signal sets are trigonometric (sinusoid) functions, 
exponential functions, Walsh functions, Bessel functions, Legendre polynomials, Laguerre functions, Jacobi polynomials, Hermite 
polynomials, and Chebyshev polynomials. The functions that concern us most in this book are the trigonometric and the exponential 
sets discussed earlier in this chapter. 


LEGENDRE FOURIER SERIES 
A set of Legendre polynomials P,,(t) (n=0, 1, 2, 3, ...) forms a complete set of mutually orthogonal functions over an interval (—1 <t< 


1). These polynomials can be defined by the Rodrigues formula: 
fa 


4 


" = *“— 1)" = Dol o2vsca 
Pa(t) 2'n! dt (¢ ) : 

It follows from this equation that 

Po(t) = 1 

Pi(t) =1 


P,{t) = ($1? — 5) 
P3(t) = (32° — 31) 


and so on. 


We may verify the orthogonality of these polynomials by showing that 
I 0 msn 
/ Py (t) Py(t) dt = 2 (6.87) 
-! nm=n 
2m +1 


We can express a function x(t) in terms of Legendre polynomials over an interval (—1 <f< 1) as 


x(t) = coPolt) +e Pit) +--+ ++ (6.88) 
where 
1 
[ xorwd 
* 1 
C= — 
[ Pewar 
1 
ar +1 fs 
se s [sora (6.89) 
i 


Note that although the series representation is valid over the interval (—1, 1), it can be extended to any interval by the appropriate time 
scaling (see Prob. 6.5-8). 


EXAMPLE 6.12 


Let us consider the square signal shown in Fig. 6.23. This function can be represented by Legendre Fourier series: 


xHD=OoOP\(HN+ah(O+-:-+6PR(O)+:-: 


Figure 6.23 
The coefficients cg, C1, C2, ..., Cc; may be found from Eq. (6.89). We have 
1 --—-L<t<0 
x(t) = 
—1 --O<t<!1 


and 


1 1 
= >| x(t)dt=0 
1 


1 0 1 
a=Zf moa=5(f rar [ rdt) -- 


5p Ko it 
aas fxm (5 -5)ar=0 


This result follows immediately from the fact that the integrand is an odd function of t. In fact, this is true of all c, for even values of 1, 
that is, 
CO@=a=a=C=-:=0 


Also, 
= tf x (30 - st) at = ; f (Se - st) at +f - (Ge- 3) ar] =i 
In a similar way, coefficients cs, c7, ... can be evaluated. We now have 
x(t) = -314+2(3 -—31) +--- (6.90) 
TRIGONOMETRIC FOURIER SERIES 
We have already proved [see Eqs. (6.7)] that the trigonometric signal set 
{1, CoS @pf, COS 2a@pl, ..., COSMNapf, ...4 
(6.91) 
Sin @pt, Sin2@pr, ..., SINNa@sf, ...} 


is orthogonal over any interval of duration Tg, where To=1/fo is the period of the sinusoid of frequency fo. This is a complete set for a 


class of signals with finite energies." 1], [12] Therefore we can express a signal x(t) by a trigonometric Fourier series over any interval 
of duration Tg seconds as 
X(t) = dp + 4; COS @ot + 42 COS Zoot + --- 


+h; sin @ot + bo sin 2@ot + --- 


or 
x1) = a+ a Ay COS N@ol + b, sin nadot h<t<4+h (6.92a) 
aol 
where 
2x 
Wy) = 2x fy = — (6.92b) 
To 
We can use Eq. (6.76) to determine the Fourier coefficients ag, aj, and by. Thus 
h+To 
' x(t) cos Naot dt 
{cra (6.93) 


>To P 
/ cos’ Naot dt 


ii 


The integral in the denominator of Eq. (6.93) has already been found to be To/2 when n + O [Eq. (6.7a) with m=n]. For n=0, the 
denominator is Tg. Hence 


1 h+Th 
=> / x(t)dt (6,.94a) 
Th nh 
and 


2 h+To 
a, = z/ X(f) COS Nwot dt 0215253550 (6.94b) 
OIh 


Similarly, we find that 
2 +7 
b= = | X(f) sin nwt dt n=1,2,3,... (6.94¢) 
0 th 


Note that the Fourier series in Eq. (6.85) of Example 6.11 is indeed the trigonometric Fourier series with Tg=21t and Wo=2Tt/To. In this 
particular example, it is easy to verify from Eqs. (6.94a) and (6.94b) that a,=0 for all n, including n=0. Hence the Fourier series in that 
example consisted only of sine terms. 


EXPONENTIAL FOURIER SERIES 


As shown in the footnote on page 624, the set of exponentials Qf?0t (n=0, +1, +2, ...) is a set of functions orthogonal over any interval 
of duration Tg=2Tt/Wwo. An arbitrary signal x(t) can now be expressed over an interval (f;, tf; + Tp) as 


x 
x)= >> De H<t<nt+h (6.95a) 
where [see Eq. (6.82)] 
h+To ; 
D, == | x(tye 7" dt (6.95b) 
To Jt 


WHY USE THE EXPONENTIAL SET? 


If x(t) can be represented in terms of hundreds of different orthogonal sets, why do we exclusively use the exponential (or trigonometric) 
set for the representation of signals or LT| systems? It so happens that the exponential signal is an eigenfunction of LTI systems. In 
other words, for an LTI system, only an exponential input e* yields the response that is also an exponential of the same form, given by 


H(s)e*!. The same is true of the trigonometric set. This fact makes the use of exponential signals natural for LTI systems in the sense 
that the system analysis using exponentials as the basis signals is greatly simplified. 


[t]This section closely follows the material from the author's earlier book!'°], Omission of this section will not cause any discontinuity in 
understanding the rest of the book. Derivation of Fourier series through the signal-vector analogy provides an interesting insight into 
signal representation and other topics such as signal correlation, data truncation, and signal detection. 


[tlLathi, B. P. Signals, Systems, and Communication. Wiley, New York, 1965. 
[tlFor complex signals the definition is modified as in Eq. (6.65), in Section 6.5-3. 


[T]Contrast this situation with polynomial approximation of x(t). Suppose we wish to find a two-point approximation of x(t) by a 
polynomial in ¢; that is, the polynomial is to be equal to x(t) at two points t, and tg. This can be done by choosing a first-order 
polynomial ag + a,t with 

x(t) = do + ah and X(t2) = do + alo 

Solution of these equations yields the desired values of ag and a4. For a three-point approximation, we must choose the polynomial ag 
+ ayt + aot with 

X(t) =Got+a@i tao? i=1,2,and3 


The approximation improves with larger number of points (higher-order polynomial), but the coefficients a9, a1, a2, ..., do not have the 
finality property. Every time we increase the number of terms in the polynomial, we need to recalculate the coefficients. 


[T]Note that the energy of a signal cx(f) is c* Ey. 

[t]This sine set, along with the cosine set cos 0 f, cos 21, ..., cos nt, ..., forms a complete set. In this case, however, the coefficients c; 
corresponding to the cosine terms are zero. For this reason, we have omitted cosine terms in this example. This composite sine and 
cosine set is the basis set for the trigonometric Fourier series. 


[11]walker P. L. The Theory of Fourier Series and Integrals. Wiley, New York, 1986. 


[12] Churchill, R. V., and J. W. Brown. Fourier Series and Boundary Value Problems, 3rd ed. McGraw-Hill, New York, 1978. 


6.6 NUMERICAL COMPUTATION OF D,, 


We can compute D, numerically by using the DFT (the discrete Fourier transform discussed in Section 8.5), which uses the samples of 
a periodic signal x(t) over one period. The sampling interval is T seconds. Hence, there are No=79/T number of samples in one period 
Tg. To find the relationship between D, and the samples of x(t), consider Eq. (6.29b) 


I 
D, = ral x(hje aimed | 
T QT 
No-1 
=lim — > x(kT)e in" TF 
T+0 Not k=0 
No=! 
= lim — 5° x(kT)e7/"™* (6.96) 
where x(kT) is the kth sample of x(t) and 
T, 2x 
No = = Q = ayT = — (6.97) 
Oo 


In practice, it is impossible to make T — 0 in computing the right-hand side of Eq. (6.96). We can make T small, but not zero, which will 
cause the data to increase without limit. Thus, we shall ignore the limit on Tin Eq. (6.96) with the implicit understanding that T is 
reasonably small. Nonzero T will result in some computational error, which is inevitable in any numerical evaluation of an integral. The 
error resulting from nonzero T is called the aliasing error, which is discussed in more detail in Chapter 8. Thus, we can express Eq. 
(6.96) as 
No-! 
Dy = — > x(kT eo (6.98a) 
" No > 


Now, from Eq. (6.97), QgNo=2t1. Hence, e/2o(KtN O)=¢/20 k and from Eq. (6.98a), it follows that 


Dik D, (6.98b) 


The periodicity property Dn+Ny=Pn means that beyond n=N /2, the coefficients represent the values for negative n. For instance, when 
No=32, D47=D-15, D4g=D_44, ..., D34=D-_-1. The cycle repeats again from n=32 on. 


We can use the efficient FFT (the fast Fourier transform discussed in Section 8.6) to compute the right-hand side of Eq. (6.98b). We 
shall use MATLAB to implement the FFT algorithm. For this purpose, we need samples of x(t) over one period starting at f = 0. In this 


algorithm, it is also preferable (although not necessary) that No be a power of 2, that is Ng=2, where m is an integer. 


COMPUTER EXAMPLE C6.4 
Numerically compute and then plot the trigonometric and exponential Fourier spectra for the periodic signal in Fig. 6.2a (Example 6.1). 


The samples of x(t) start at t =O and the last (Noth) sample is at f=Tg — T. At the points of discontinuity, the sample value is taken as 
the average of the values of the function on two sides of the discontinuity. Thus, the sample at tf =O is not 1 but (e-w2 + 1)/2 =0.604. 
To determine No, we require that Dy, for n = No/2 to be negligible. Because x(t) has a jump discontinuity, D, decays rather slowly as 
1/n. Hence, a choice of Ng=200 is acceptable because the (Ng/2)nd (100th) harmonic is about 1% of the fundamental. However, we 


also require Ng to be power of 2. Hence, we shall take No=256=2.[8] 


First, the basic parameters are established. 


>> T 0 Sopris NO | 2567 TST -O/N.OF 
+ 


(O:T:T*(N 0-1))'; M = 10; 
>> x = exp(-t/2); x(1) = (exp(-pi/2) ~ 


1) /2: 


Next, the DFT, computed by means of the fft function, is used to approximate the exponential Fourier spectra over -M <n <M. 
>> Dn = fft (x)/N_0; n = [-N_0/2:N_0/2-1]'; 


>> clf; subplot (2, 2, 1); stem(n, abs(fftshift (Dn)),'k'); 

>> axis ([-MM -.1 .6]); xlabel('n'); ylabel('|D_n]J"'); 

>> subplot (2, 2, 2); stem(n, angle(fftshift(D n)),'k'); 

>> axis([-M M -pi pi]); xlabel ('n'); ylabel('\angle Dn [rad]'); 


The approximate trigonometric Fourier spectra over 0 < n < M immediately follow. 
>> n = [0:M]; C_n(1) = abs(D n(1)); C _n(2:M+1) = 2*abs (D n(2:M+1)); 


>> theta_n(1) = angle(D_n(1)); theta_n(2:M+1) = angle(D_n(2:M+1)); 


>> subplot (2, 2, 3); stem(n,C_n,'k'); 


>> xlabel ('n') 
>> subplot (2, 
>> xlabel ('n') 


7; ylabel('C_n'); 
2, 4); stem(n,theta_n,'k"'); 
; ylabel('\theta n [rad]'); 
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Figure C6.4 


[8]Bécher, M. Annals of Mathematics, vol. 7, no. 2, 1906. 


6.7 SUMMARY 


In this chapter we showed how a periodic signal can be represented as a sum of sinusoids or exponentials. If the frequency of a 
periodic signal is fg, then it can be expressed as a weighted sum of a sinusoid of frequency fg and its harmonics (the trigonometric 


Fourier series). We can reconstruct the periodic signal from a knowledge of the amplitudes and phases of these sinusoidal components 
(amplitude and phase spectra). 


If a periodic signal x(t) has an even symmetry, its Fourier series contains only cosine terms (including dc). In contrast, if x(t) has an odd 
symmetry, its Fourier series contains only sine terms. If x(t) has neither type of symmetry, its Fourier series contains both sine and 
cosine terms. 


At points of discontinuity, the Fourier series for x(t) converges to the mean of the values of x(t) on either sides of the discontinuity. For 
signals with discontinuities, the Fourier series converges in the mean and exhibits Gibbs phenomenon at the points of discontinuity. The 
amplitude spectrum of the Fourier series for a periodic signal x(t) with jump discontinuities decays slowly (as 1/n) with frequency. We 
need a large number of terms in the Fourier series to approximate x(t) within a given error. In contrast, smoother periodic signal 
amplitude spectrum decays faster with frequency and we require a fewer number of terms in the series to approximate x(t) within a 
given error. 


A sinusoid can be expressed in terms of exponentials. Therefore the Fourier series of a periodic signal can also be expressed as a sum 
of exponentials (the exponential Fourier series). The exponential form of the Fourier series and the expressions for the series 
coefficients are more compact than those of the trigonometric Fourier series. Also, the response of LTIC systems to an exponential 
input is much simpler than that for a sinusoidal input. Moreover, the exponential form of representation lends itself better to 
mathematical manipulations than does the trigonometric form. For these reasons, the exponential form of the series is preferred in 
modern practice in the areas of signals and systems. 


The plots of amplitudes and angles of various exponential components of the Fourier series as functions of the frequency are the 
exponential Fourier spectra (amplitude and angle spectra) of the signal. Because a sinusoid cos Wof can be represented as a sum of 


two exponentials, el¥0t ang eft the frequencies in the exponential spectra range from Tr =— to o. By definition, frequency of a 
signal is always a positive quantity. Presence of a spectral component of a negative frequency —nwWg merely indicates that the Fourier 


series contains terms of the form e/”“o!. The spectra of the trigonometric and exponential Fourier series are closely related, and one 
can be found by the inspection of the other. 


In Section 6.5 we discuss a method of representing signals by the generalized Fourier series, of which the trigonometric and 
exponential Fourier series are special cases. Signals are vectors in every sense. Just as a vector can be represented as a sum of its 
components in a variety of ways, depending on the choice of the coordinate system, a signal can be represented as a sum of its 
components in a variety of ways, of which the trigonometric and exponential Fourier series are only two examples. Just as we have 
vector coordinate systems formed by mutually orthogonal vectors, we also have signal coordinate systems (basis signals) formed by 
mutually orthogonal signals. Any signal in this signal space can be represented as a sum of the basis signals. Each set of basis signals 
yields a particular Fourier series representation of the signal. The signal is equal to its Fourier series, not in the ordinary sense, but in 


the special sense that the energy of the difference between the signal and its Fourier series approaches zero. This allows for the signal 
to differ from its Fourier series at some isolated points. 
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MATLAB SESSION 6: FOURIER SERIES APPLICATIONS 


Computational packages such as MATLAB simplify the Fourier-based analysis, design, and synthesis of periodic signals. MATLAB 
permits rapid and sophisticated calculations, which promote practical application and intuitive understanding of the Fourier series. 


M6.1 Periodic Functions and the Gibbs Phenomenon 


It is sufficient to define any To-periodic function over the interval (0 < ft < Tg). For example, consider the 21t-periodic function given by 


—t O<t<A 
A 

x(t) = 1 Ax<t<x 
0 mn<xt<27 


x(t + 277) otherwise 


Although similar to a square wave, x(t) has a linearly rising edge of width A, where (0 < A < Tr). As A — 0,x(t) approaches a square 
wave; as A — Tr, x(t) approaches a type of sawtooth wave. 


In MATLAB, the mod command helps represent periodic functions such as x(f). 


>> x = inline (['mod(t,2*pi)/A.* (mod(t,2*pi)<A) +',... 
"((mod(t,2*pi) > =A) & (mod(t,2*pi) < pi))'], 't', 'A'); 


Sometimes referred to as the signed remainder after division, mod (t,2*pi) returns the value tf modulo 2tr. Thought of another way, 
the mod operator appropriately shifts tf into [0, 7g), where x(t) is conveniently defined. When an inline object is a function of multiple 


variables, the variables are simply listed in the desired order following the function expression. 


The exponential Fourier series coefficients for x(t) (see Prob. 6.3-2) are given by 


2x —A 
_* n=0 
4x 
D,= , (M6.1) 
1 (— 1 +je ) éiuiews 
ow oe ise 
2an nA alias 


Since x(t) is real, D.,=D,*. Truncating the Fourier series at |n|=N yields the approximation 


N 
x(t) © x(t) = Do + >> (D,e™ + Die~™) (M6.2) 
aml 
Program MS 6 P1 uses Eq. (M6.2) to compute xj(t) for (0 < N < 100), each over (— 1/4 < t < 211 + TI/4). 


function [x_N,t]=MS6P1 (A); 
MS6P1. m : MATLAB Session 6, Program 1 
Function M-file approximates x(t) using Fourier series 


AP AAP AP AP AP AP 


truncated at |n| = N for (0 < = N < = 100). 
INPUTS: A = width of rising edge 
OUTPUTS: x N = output matrix, where x N(N+1,:) is the |n| = N truncation 


t=time vector for x_N 


t=linspace (-pi/4,2*pi+pi/4, 1000); % Time vector exceeds one period. 
sumterms = zeros (101, length (t)); % Pre-allocate memory 

sumterms (1,:) = (2*pi-A)/(4*pi); % Compute DC term 

for n = 1:100, % Compute N remaining terms 

D n=1/ (2*pi*n) * ((exp(-j*n*A)-1)/(n*A) + 3*exp(-j*n*pi)); 


sumterms (l+n,:) 
end 
x N = cumsum (sumterms) ; 


real (D_n*exp(j*n*t) + conj (D_n) *exp(-j*n*t)); 


Although theoretically not required, the real command ensures that small computer round-off errors do not cause a complex-valued 
result. For a matrix input, the cumsum command cumulatively sums along rows: the first output row is identical to the first input row, the 
second output row is the sum of the first two input rows, the third output row is the sum of the first three input rows, and so forth. Thus, 
row (N + 1) of x_N corresponds to the truncation of the exponential Fourier series at |n|=N. 


Setting A=11/2, Fig. M6.1 compares x(t) and x0(f). 
>> A = pi/2; [x_N,t] = MS6P1(A); 


>> plot (t,x N(Z1,:),'k',t,x(t,A),'k:'); axis([-pi/4,2*pitpi/4,-0.1,1.1]); 
>> xlabel ('€'); ylabel ('Amplitude'); legend ('x 20(t)','x(t)',0); 
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Figure M6.1: Comparison of xg9(t) and x(t) using A=11/2. 


As expected, the falling edge is accompanied by the overshoot that is characteristic of the Gibbs phenomenon. 
Increasing N to 100, as shown in Fig. M6.2, improves the approximation but does not reduce the overshoot. 


>> plot (t,x N(101,:),'k',t,x(t,A),'k:'); axis([-pi/4,2*pi+pi/4,-0.1,1.1]); 
>> xlabel('t'); ylabel ('Amplitude'); legend('x 100(t)','x(t)',0); 


Amplitude 


Figure M6.2: Comparison of x499(t) and x(t) using A=t1/2. 


Reducing A to 1t/64 produces a curious result. For N=20, both the rising and falling edges are accompanied by roughly 9% of 


overshoot, as shown in Fig. M6.3. As the number of terms is increased, overshoot persists only in the vicinity of jump discontinuities. 
For x,(t), increasing N decreases the overshoot near the rising edge but not near the falling edge. Remember that it is a true jump 
discontinuity that causes the Gibbs phenomenon. A continuous signal, no matter how sharply it rises, can always be represented by a 


Fourier series at every point within any small error by increasing N. This is not the case when a true jump discontinuity is present. 
Figure M6.4 illustrates this behavior using N=100. 
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Figure M6.4: Comparison of x499(t) and x(t) using A=11/64. 


M6.2 Optimization and Phase Spectra 


Although magnitude spectra typically receive the most attention, phase spectra are critically important in some applications. Consider 
the problem of characterizing the frequency response of an unknown system. By applying sinusoids one at a time, the frequency 
response is empirically measured one point at a time. This process is tedious at best. Applying a superposition of many sinusoids, 
however, allows simultaneous measurement of many points of the frequency response. Such measurements can be taken by a 


spectrum analyzer equipped with a transfer function mode or by applying Fourier analysis techniques, which are discussed in later 
chapters. 


A multitone test signal m(t) is constructed using a superposition of N real sinusoids 
N 
mt) = e M,, COS (@,,f + O,) (M6.,3) 


at 


where M, and 6, establish the relative magnitude and phase of each sinusoidal component. It is sensible to constrain all gains to be 
equal, M,,=M for all n. This ensures equal treatment at each point of the measured frequency response. Although the value M is 
normally chosen to set the desired signal power, we set M=1 for convenience. 
While not required, it is also sensible to space the sinusoidal components uniformly in frequency, 
N 
m(t) = ie COS (N@ot + O,) (M6.4) 

a=! 
Another sensible alternative, which spaces components logarithmically in frequency, is treated in Prob. 6.M-1. 
Equation (M6.4) is now a truncated compact-form Fourier series with a flat magnitude spectrum. Frequency resolution and range are 


set by wg and N, respectively. For example, a 2 kHz range with a resolution of 100 Hz requires wo=2Tt 100 and N=20. The only 
remaining unknowns are the 0,. 


While it is tempting to set 8,=0 for all n, the results are quite unsatisfactory. MATLAB helps demonstrate the problem by using 09=2Tt 
100 and N=20 sinusoids, each with a peak-to-peak voltage of one volt. 


>> m = inline('sum(cos(omega*t+theta*ones(size(t))))','theta','t','omega'); 
>> N = 20; omega = 2*pi*100*[1:N]'; theta = zeros(size(omega) ); 

>> t = linspace(-0.01,0.01,1000); 

>> plot(t,m(theta,t,omega),'k'); xlabel('t [sec]'); ylabel('m(t) [volts]'); 


As shown in Fig. M6.5, 8,=0 causes each sinusoid to constructively add. The resulting 20-volt peak can saturate system components, 


such as operational amplifiers operating with +12-volt rails. To improve signal performance, the maximum amplitude of m(t) over ft 
needs to be reduced. 
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Figure M6.5: Test signal m(t) with 6,=0. 


One way to reduce max; (|m(t)|) is to reduce M, the strength of each component. Unfortunately, this approach reduces the system's 
signal-to-noise ratio and ultimately degrades measurement quality. Therefore, reducing M is not a smart decision. The phases 8,, 
however, can be adjusted to reduce max; (|m/(f)|) while preserving signal power. In fact, since b,=0 maximizes max; (|m/(t)|), just about 
any other choice of 6, will improve the situation. Even a random choice should improve performance. 


As with any computer, MATLAB cannot generate truly random numbers. Rather, it generates pseudo-random numbers. Pseudo-random 
numbers are deterministic sequences that appear to be random. The particular sequence of numbers that is realized depends entirely on 
the initial state of the pseudo-random-number generator. Setting the generator's initial state to a known value allows a "random" 
experiment with reproducible results. The command rand ('state', 0) initializes the state of the pseudorandom number generator 
to a known condition of zero, and the MATLAB command rand (a, b) generates an a-by-b matrix of pseudo-random numbers that 
are uniformly distributed over the interval (0, 1). Radian phases occupy the wider interval (0, 21), so the results from rand need to be 
appropriately scaled. 


>> rand ('statr' 0); theta_randO =2*pi*rand(N, 1); 


By using the randomly chosen 6, m(t) is computed, the maximum magnitude is identified, and the results are plotted as shown in Fig. 
M6.6. 


>> m randOQ =m (theta rand0,t,omega) ; 

>> [max mag,max ind] = max(abs(m rand0(l:end/2))); 
>> plot (t,m randO,'k'); axis([-0.01,0.01,-10,10]); 
>> xlabel('t [sec]'); ylabel ('m(t) [volts]"'); 


>> text (t(max_ind),m_rand0O(max_ind,... 
['\leftarrow max = ',num2str(m rand0O (max ind))]); 


8 max = 7.1741 
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—0.008 —0.004 0 0.004 = 0.008 
t (seconds) 
Figure M6.6: Test signal m(t) with random 8, found by using rand ('state', 0). 


For a vector input, the max command returns the maximum value and the index corresponding to the first occurrence of the maximum. 
Similarly, although not used here, the MATLAB command min determines and locates minima. The text (a, b, c) command 
annotates the current figure with the string c at the location (a, b).MATLAB's help facilities describe the many properties availabel to 
adjust the appearance and format delivered by the text command. The /leftarrow command produces the symbol ~—. Similarly, 
/vightarrow, /uparrow, and /downarrow produce the symbols —1, and |, respectively. 


Randomly chosen phases suffer a fatal fault: there is little guarantee of optimal performance. For example, repeating the experiment 
with rand ('state', 1) produces a maximum magnitude of 9.1 volts, as shown in Fig. M6.7. This value is significantly higher than 
the previous maximum of 7.2 volts. Clearly, it is better to replace a random solution with an optimal solution. 
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m(f) (volts) 


max = —9.1252 
—0.008 —0.004 0 0.004 0.008 


t (seconds) 
Figure M6.7: Test signal m(t) with random 6, found by using rand ('state', 1). 


-10 


What constitutes "optimal"? Many choices exist, but desired signal criteria naturally suggest that optimal phases minimize the maximum 
magnitude of m(t) over all f. To find these optimal phases, MATLAB's fminsearch command is useful. First, the function to be 
minimized, called the objective function, is defined. 


>> maxmagm = inline('max (abs(sum(cos (omega*tt+theta*ones(size(t))))))',... 
"theta'’,'t','omega'); 


The inline argument order is important; fminsearch uses the first input argument as the variable of minimization. To minimize over 
8, as desired, 8 must be the first argument of the objective function maxmagm. 


Next, the time vector is shortened to include only one period of m(t). 
>> t = linespace(0, 0.01, 201) ; 


A full period ensures that all values of m(t) are considered; the short length of t helps ensure that functions execute quickly. An initial 
value of t is randomly chosen to begin the search. 


>> rand('state', 0); theta_init = 2*pi*rand(N,1); 
>> theta_opt = fminsearch(maxmagm,theta_int, [], t, omega); 


Notice that fminsearch finds the minimizer to maxmagm over 8 by using an initial value theta_init. Most numerical minimization 
techniques are capable of finding only local minima, and fminsearch is no exception. As a result, fminsearch does not always 
produce a unique solution. The empty square brackets indicate no special options are requested, and the remaining ordered arguments 
are secondary inputs for the objective function. Full format details for fminsearch are available from MATLAB's help facilities. 


Figure M6.8 shows the phase-optimized test signal. The maximum magnitude is reduced to a value of 5.4 volts, which is a significant 
improvement over the original peak of 20 volts. 
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Figure M6.8: Test signal m(t) with optimized phases. 


Although the signals shown in Figs. M6.5 through M6.8 look different, they all possess the same magnitude spectra. They differ only in 
phase spectra. It is interesting to investigate the similarities and differences of these signals in ways other than graphs and 
mathematics. For example, is there an audible difference between the signals? For computers equipped with sound capability, the 
MATLAB sound command can be used to find out. 

>> Fs = 8000; t = [0:1/Fs:2]; % Two second records at a sampling rate of 8kHz 


>> m0 = m(theta,t,omega); % m(t) using zero phases 
>> sound(m 0/20,Fs); 


Since the sound command clips magnitudes that exceed one, the input vector is scaled by 1/20. The remaining signals are created 
and played in a similar fashion. How well does the human ear discern the differences in phase spectra? 


PROBLEMS 


6.1.1 For each of the periodic signals shown in Fig. P6.1-1, find the compact trigonometric Fourier series and sketch the 
amplitude and phase spectra. If either the sine or cosine terms are absent in the Fourier series, explain why. 


Figure P6.1-1 


a. Find the trigonometric Fourier series for y(t) shown in Fig. P6.1-2. 


ge 1 wh 


Figure P6.1-2 


b. The signal y(t) can be obtained by time reversal of x(t) shown in Fig. 6.2a. Use this fact to obtain the 
Fourier series for y(t) from the results in Example 6.1. Verify that the Fourier series thus obtained is 
identical to that found in part (a). 


c. Show that, in general, time reversal of a periodic signal does not affect the amplitude spectrum, and the 
phase spectrum is also unchanged except for the change of sign. 


a. Find the trigonometric Fourier series for the periodic signal y(t) depicted in Fig. P6.1-3. 


lw 7 wil 0 w/2 7 t—~- tlw 


Figure P6.1-3 


b. The signal y(t) can be obtained by time compression of x(t) shown in Fig. 6.2a by a factor 2. Use this fact 
to obtain the Fourier series for y(t) from the results in Example 6.1. Verify that the Fourier series thus 
obtained is identical to that found in part (a). 


c. Show that, in general, time-compression of a periodic signal by a factor a expands the Fourier spectra 
along the Q axis by the same factor a. In other words Co, Cy, and 8, remain unchanged, but the 
fundamental frequency is increased by the factor a, thus expanding the spectrum. Similarly time expansion 
of a periodic signal by a factor a compresses its Fourier spectra along the © axis by the factor a. 


a. Find the trigonometric Fourier series for the periodic signal g(t) in Fig. P6.1-4. Take advantage of the 
symmetry. 


6.1.5 


Figure P6.1-4 


b. Observe that g(t) is identical to x(t) in Fig. 6.3a left-shifted by 0.5 second. Use this fact to obtain the 
Fourier series for g(t) from the results in Example 6.2. Verify that the Fourier series thus obtained is 
identical to that found in part (a). 


c. Show that, in general, a time shift of T seconds of a periodic signal does not affect the amplitude spectrum. 
However, the phase of the nth harmonic is increased or decreased nwgT depending on whether the signal 


is advanced or delayed by T seconds. 


If the two halves of one period of a periodic signal are identical in shape except that one is the negative of the other, the 
periodic signal is said to have a half-wave symmetry. If a periodic signal x(t) with a period To satisfies the half-wave 
symmetry condition, then 


x[t— a) = —x(t) 


In this case, show that all the even-numbered harmonics vanish and that the odd-numbered harmonic coefficients are 
given by 


To/2 
a, = — X(1) COS Naot dt 
To Jo 
and 
To/2 
b,=— x(t) sin neot dt 
To Jo 


Using these results, find the Fourier series for the periodic signals in Fig. P6.1-5. 


Figure P6.1-5 


Over a finite interval, a signal can be represented by more than one trigonometric (or exponential) Fourier series. For 
instance, if we wish to represent x(t)=t over an interval 0 < f< 1 by a Fourier series with fundamental frequency wo=2, 
we can draw a pulse x(t)=t over the interval 0 < t< 1 and repeat the pulse every Tt seconds so that Tg=T and O9=2 
(Fig. P6.1-6a). If we want the fundamental frequency Qg to be 4, we repeat the pulse every Tt/2 seconds. If we want the 
series to contain only cosine terms with wg=2, we construct a pulse x(t)=|¢| over — 1 < ¢t< 1, and repeat it every Tr 
seconds (Fig. P6.1-6b). The resulting signal is an even function with period tr. Hence, its Fourier series will have only 
cosine terms with wg=2. The resulting Fourier series represents x(ft)=t over 0 < t< 1, as desired. We do not care what it 
represents outside this interval. 
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Figure P6.1-6 


Sketch the periodic signal x(t) such that x(t)=t for 0 < t< 1 and the Fourier series for x(t) satisfies the following 
conditions. 


a. Wo=Tt/2 and contains all harmonics, but cosine terms only 


b. Wo=2 and contains all harmonics, but sine terms only 


C. Wo=Tt/2 and contains all harmonics, which are neither exclusively sine nor cosine 

d. Wo=1 and contains only odd harmonics and cosine terms 

@. Wo=Tt/2 and contains only odd harmonics and sine terms 

f. Wo=1 and contains only odd harmonics, which are neither exclusively sine nor cosine. 


[Hint: For parts (d), (e), and (f), you need to use half-wave symmetry discussed in Prob. 6.1-5. Cosine terms imply 
possible dc component.] You are asked only to sketch the periodic signal x(t) satisfying the given conditions. Do not find 
the values of the Fourier coefficients. 


6.1.7 | State with reasons whether the following signals are periodic or aperiodic. For periodic signals, find the period and state 
which of the harmonics are present in the series. 


a. 3sint+2 sin 3t 

b. 2+5sin4t+4 cos /7t 
c. 2 sin 3t+ 7 cos Tit 

d. 7 cos tft +5 sin 2trt 


e. 3cos /2t+ 5 cos 2t 


St 61 t 
sin — + 3cos — + 3sin{ = + 30° 
F 1 5) co 5 + 1 (4 ) 


; 15 
sin 3f + cos ri 


h. (3 sin 2t + sin 5t)? 
i. (5 sin 2t)3 
6.3.1 For each of the periodic signals in Fig. P6.1-1, find exponential Fourier series and sketch the corresponding spectra. 
6.3.2 A 211t-periodic signal x(t) is specified over one period as 
rt O<ft<A 


(1) = 1 A<t<z 


0 a<t<2n 


Sketch x(f) over two periods from t=0 to 411. Show that the exponential Fourier series coefficients D, for this series are 


given by 
27 —A 
—_- n=0 
4x 
Dy _ l e jAn 1 
— | —_—_—_— otherwise 
2nn ( An ) 


6.3.3 A periodic signal x(t) is expressed by the following Fourier series: 


x(t) = 3cost+sin|5t— = —2cos| 8f— 5 


a. Sketch the amplitude and phase spectra for the trigonometric series. 

b. By inspection of spectra in part (a), sketch the exponential Fourier series spectra. 

c. By inspection of spectra in part (b), write the exponential Fourier series for x(t). 

d. Show that the series found in part (c) is equivalent to the trigonometric series for x(t). 


6.3.4 The trigonometric Fourier series of a certain periodic signal is given by 


x(t) =3+ J3 cos 21 + sin 2f 


. ] x 
+ sin 3f — 5 008 (s¢ + =) 


a. Sketch the trigonometric Fourier spectra. 

b. By inspection of spectra in part (a), sketch the exponential Fourier series spectra. 

c. By inspection of spectra in part (b), write the exponential Fourier series for x(t). 

d. Show that the series found in part (c) is equivalent to the trigonometric series for x(f). 


6.3.5 The exponential Fourier series of a certain function is given as 
x(t) = (2+ j2je" + j2e# 


+3 — j2e! + (2— j2)e™ 
a. Sketch the exponential Fourier spectra. 


b. By inspection of the spectra in part (a), sketch the trigonometric Fourier spectra for x(t). Find the compact 
trigonometric Fourier series from these spectra. 


c. Show that the trigonometric series found in part (b) is equivalent to the exponential series for x(?). 
d. Find the signal bandwidth. 
6.3.6 Figure P6.3-6 shows the trigonometric Fourier spectra of a periodic signal x(t). 
a. By inspection of Fig. P6.3-6, find the trigonometric Fourier series representing x(t). 
b. By inspection of Fig. P6.3-6, sketch the exponential Fourier spectra of x(t). 


c. By inspection of the exponential Fourier spectra obtained in part (b), find the exponential Fourier series for 
x(t). 


d. Show that the series found in parts (a) and (c) are equivalent. 
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Figure P6.3-6 
6.3.7 Figure P6.3-7 shows the exponential Fourier spectra of a periodic signal x(¢). 


a. By inspection of Fig. P6.3-7, find the exponential Fourier series representing x(f). 
b. By inspection of Fig. P6.3-7, sketch the trigonometric Fourier spectra for x(t). 


c. By inspection of the trigonometric Fourier spectra found in part (b), find the trigonometric Fourier series for 
x(t). 


d. Show that the series found in parts (a) and (c) are equivalent. 
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Figure P6.3-7 


6.3.8 


a. Find the exponential Fourier series for the signal in Fig. P6.3-8a. 
Figure P6.3-8 

b. Using the results in part (a), find the Fourier series for the signal &(t)in Fig. P6.3-8b, which is a time- 
shifted version of the signal 0(f). 

c. Using the results in part (a), find the Fourier series for the signal X(t) in Fig. P6.3-8c, which is a time- 
scaled version of the signal x(f). 

6.3.9 If a periodic signal x(t) is expressed as an exponential Fourier series 
oO 


x(t) = i D, ei"! 


a. 


6.3.10 


6.3.11 


Show that the exponential Fourier series for t(f) = x(f — T) is given by 
oO 
£(t) = S> Deine! 
aAa=—% 
in which 
[Del =1Dal and 2D, = 2D, —nooT 


This result shows that time-shifting of a periodic signal by T seconds merely changes the phase spectrum 
by nwgT. The amplitude spectrum is unchanged. 


_ Show that the exponential Fourier series for * (1) = X(T) is given by 
oo 


X(1)}= }° Dyelnien 


at=—00 
This result shows that time compression of a periodic signal by a factor a expands its Fourier spectra 


along the w axis by the same factor a. Similarly, time expansion of a periodic signal by a factor a 
compresses its Fourier spectra along the w axis by the factor a. Can you explain this result intuitively? 


. The Fourier series for the periodic signal in Fig. 6.6a is given in Exercise E6.1. Verify Parseval's theorem 


for this series, given that 
4 


= l Fa 
er 


n=l 


. If x(t) is approximated by the first N terms in this series, find N so that the power of the error signal is less 


than 1% of Py. 


. The Fourier series for the periodic signal in Fig. 6.6b is given in Exercise E6.1. Verify Parseval's theorem 


for this series, given that 


— 1 x? 
Las 


n=l 


. If x(t) is approximated by the first N terms in this series, find N so that the power of the error signal is less 


than 10% of Py. 


6.3.12 The signal x(t) in Fig. 6.14 is approximated by the first 2N + 1 terms (from n=-N to N) in its exponential Fourier series 
given in Exercise E6.5. Determine the value of N if this (2N + 1)-term Fourier series power is to be no less than 
99.75% of the power of x(f). 


6.4.1 Find the response of an LTIC system with transfer function 


H(s) = ————— 
(s) s*+254+3 


to the periodic input shown in Fig. 6.2a. 


6.4.2 
a. Find the exponential Fourier series for a signal x(t)=cos 5f sin 3f. You can do this without evaluating any 


integrals. 


b. Sketch the Fourier spectra. 


c. The signal x(t) is applied at the input of an LTIC system with frequency response, as shown in Fig. P6.4-2. 
Find the output y(¢). 


H() 


Figure P6.4-2 


6.4.3 
a. Find the exponential Fourier series for a periodic signal x(t) shown in Fig. P6.4-3a. 


xO) 


Figure P6.4-3 


b. The signal x(t) is applied at the input of an LTIC system shown in Fig. P6.4-3b. Find the expression for the 
output y(t). 


6.5.1 Derive Eq. (6.51) in an alternate way by observing that e=(x — c y) and |e|2=(x — cy): (x —c y)=|x|? + c2ly|? — 2c x 
-y. 


6.5.2 A signal x(t) is approximated in terms of a signal y(t) over an interval (t4, ta): 
x(t) = cy(t) b<t<h 


where c is chosen to minimize the error energy. 
a. Show that y(t) and the error e(f)=x(t) — cy(t) are orthogonal over the interval (f1, f2). 
b. Can you explain the result in terms of the signal-vector analogy? 


c. Verify this result for the square signal x(t) in Fig. 6.19 and its approximation in terms of signal sin ¢. 


6.5.3 If x(t) and y(t) are orthogonal, then show that the energy of the signal x(t) + y(t) is identical to the energy of the signal 
x(t) — y(t) and is given by E +€E . Explain this result by using the vector analogy. In general, show that for orthogonal 


x oy 
signals x(t) and y(t) and for any pair of arbitrary real constants c1, and co, the energies of c4x(t) + coy(t) and c;x(t) — 
c2Y(t) are identical, given by c42E, + 65°F). 

6.5.4 
a. For the signals x(t) and y(t) depicted in Fig. P6.5-4, find the component of the form y(t) contained in x(¢). In 


other words find the optimum value of c in the approximation x(t) = cy(t) so that the error signal energy is 
minimum. 


b. Find the error signal e(t) and its energy Eg. Show that the error signal is orthogonal to y(f), and that 


(Fog a + E,. Can you explain this result in terms of vectors. 


6.5.5 For the signals x(t) and y(t) shown in Fig. P6.5-4, find the component of the form x(t) contained in y(t). In other words, 
find the optimum value of c in the approximation y(t) = cx(t) so that the error signal energy is minimum. What is the 
error signal energy? 


6.5.6 Represent the signal x(t) shown in Fig. P6.5-4a over the interval from 0 to 1 by a trigonometric Fourier series of 
fundamental frequency O9=2Tt. Compute the error energy in the representation of x(t) by only the first N terms of this 
series for N=1, 2, 3, and 4. 


6.5.7 Represent x(f)=¢ over the interval (0, 1) by a trigonometric Fourier series that has 
a. Wo=2Tt and only sine terms 
b. Wo=Tr and only sine terms 
C. Wo=Tt and only cosine terms 
You may use a dc term in these series if necessary. 


6.5.8 In Example 6.12, we represented the function in Fig. 6.23 by Legendre polynomials. 


a. Use the results in Example 6.12 to represent the signal g(t) in Fig. P6.5-8 by Legendre polynomials. 


Figure P6.5-8 


b. Compute the error energy for the approximations having one and two-(nonzero) terms. 


6.5.9 | Walsh functions, which can take on only two amplitude values, form a complete set of orthonormal functions and are of 
great practical importance in digital applications because they can be easily generated by logic circuitry and because 
multiplication with these functions can be implemented by simply using a polarity-reversing switch. Figure P6.5-9 shows 
the first eight functions in this set. Represent x(t) in Fig. P6.5-4a over the interval (0, 1) by using a Walsh Fourier series 
with these eight basis functions. Compute the energy of e(f), the error in the approximation, using the first N nonzero 
terms in the series for N=1, 2, 3, and 4. We found the trigonometric Fourier series for x(t) in Prob. 6.5-6. How does the 
Walsh series compare with the trigonometric series in Prob. 6.5-6 from the viewpoint of the error energy for a given N? 
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Figure P6.5-9 


MATLAB Session 6 discusses the construction of a phase-optimized multitone test signal with linearly spaced frequency 
components. This problem investigates a similar signal with logarithmically spaced frequency components. 


A multitone test signal m(t) is constructed by using a superposition of N real sinusoids 
N 


m(t) = J coset + 6) 


n=! 


where 6, establishes the relative phase of each sinusoidal component. 


a. Determine a suitable set of N=10 frequencies tr, that logarithmically spans [(2Tr) < Tr < 100(21r)] yet still 
results in a periodic test signal m(t). Determine the period To of your signal. Using 8,=0. plot the resulting 
(To)-periodic signal over-To/2 < t < To/2. 


b. Determine a suitable set of phases 6, that minimize the maximum magnitude of m(t). Plot the resulting 
signal and identify the maximum magnitude that results. 


c. Many systems suffer from what is called one-over-f noise. The power of this undesirable noise is 
proportional to 1/f. Thus, low-frequency noise is stronger than high-frequency noise. What modifications to 
m(t) are appropriate for use in environments with 1/f noise? Justify your answer. 


Chapter 7: Continuous-Time Signal Analysis-The Fourier Transform 


OVERVIEW 


We can analyze linear systems in many different ways by taking advantage of the property of linearity, where by the input is expressed 
as a sum of simpler components. The system response to any complex input can be found by summing the system's response to these 
simpler components of the input. In time-domain analysis, we separated the input into impulse components. In the frequency-domain 
analysis in Chapter 4, we separated the input into exponentials of the form est (the Laplace transform), where the complex frequency s= 
o + jw. The Laplace transform, although very valuable for system analysis, proves somewhat awkward for signal analysis, where we 
prefer to represent signals in terms of exponentials e/F instead of eS. This is accomplished by the Fourier transform. In a sense, the 
Fourier transform may be considered to be a special case of the Laplace transform with s=jw. Although this view is true most of the 
time, it does not always hold because of the nature of convergence of the Laplace and Fourier integrals. 


In Chapter 6, we succeeded in representing periodic signals as a sum of (everlasting) sinusoids or exponentials of the form elt The 
Fourier integral developed in this chapter extends this spectral representation to aperiodic signals. 


7.1 APERIODIC SIGNAL REPRESENTATION BY FOURIER INTEGRAL 


Applying a limiting process, we now show that an aperiodic signal can be expressed as a continuous sum (integral) of everlasting 
exponentials. To represent an aperiodic signal x(t) such as the one depicted in Fig. 7.1a by everlasting exponentials, let us construct a 
new periodic signal x79(t) formed by repeating the signal x(t) at intervals of Tg seconds, as illustrated in Fig. 7.1b. The period Tg is 
made long enough to avoid overlap between the repeating pulses. The periodic signal x79(t) can be represented by an exponential 
Fourier series. If we let Tg — oo, the pulses in the periodic signal repeat after an infinite interval and, therefore 


lim xz, (1) = x(0) 
To-+00 


Figure 7.1: Construction of a periodic signal by periodic extension of x(t). 


Thus, the Fourier series representing x79(f) will also represent x(t) in the limit Tg — oo. The exponential Fourier series for x79(f) is 
given by 


oo 


xn(t)= ) > Dye"! (7.1) 
where 
l To/2 
D= = | Xx, (te 2""'dt (7.2a) 
Th To /2 
and 
2x 
HS (7.2b) 
To 


Observe that integrating x79(t) over (— To/2, To/2) is the same as integrating x(t) over (— co, «). Therefore, Eq. (7.2a) can be 
expressed as 


el 
D, = z | x(the "dt (7.2c) 


It is interesting to see how the nature of the spectrum changes as To increases. To understand this fascinating behavior, let us define 


X(), a continuous function of w, as 


oO 
X(@) = / x(the dt (7.3) 
A glance at Eqs. (7.2c) and (7.3) shows that 
I 
D, = =X (nwo) (7.4) 
To 
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Figure 7.2: Change in the Fourier spectrum when the period Tg in Fig. 7.1 is doubled. 


This means that the Fourier coefficients D, are 1/To times the samples of X(w) uniformly spaced at intervals of Wa, as depicted in Fig. 


7.2a.[T] Therefore, (1/7 )X(w) is the envelope for the coefficients D,. We now let Tg — by doubling Tp repeatedly. Doubling To 
halves the fundamental frequency Wg [Eq. (7.2b)], so that there are now twice as many components (samples) in the spectrum. 
However, by doubling Tp, the envelope (1/T9)X(w) is halved, as shown in Fig. 7.2b. If we continue this process of doubling To 
repeatedly, the spectrum progressively becomes denser while its magnitude becomes smaller. Note, however, that the relative shape of 
the envelope remains the same [proportional to X(w) in Eq. (7.3)]. In the limit as Tg — ©, Wo — O and Dy, — O. This result makes for 
a spectrum so dense that the spectral components are spaced at zero (infinitesimal) intervals. At the same time, the amplitude of each 
component is zero (infinitesimal). We have nothing of everything, yet we have something! This paradox sounds like Alice in 


Wonderland, but as we shall see, these are the classic characteristics of a very familiar phenomenon.|#] 


Substitution of Eq. (7.4) in Eq. (7.1) yields 


“. X(na@) , 
X7,(t) = > aot ein (7.5) 


a=—oo 


As Tg — ©, Wg becomes infinitesimal (Wa — 0). Hence, we shall replace Wo by a more appropriate notation, Aw. In terms of this new 
notation, Eq. (7.2b) becomes 


2x 
Ao=— 
To 
and Eq. (7.5) becomes 
X(nAw)A 
xn (t) = y | { ne | eindoy (7.6a) 


Equation (7.6a) shows that x7 9(t) can be expressed as a sum of everlasting exponentials of frequencies 0, tAw, +2Aw, +3Aw.,... (the 
Fourier series). The amount of the component of frequency nAw is [X(nAw)Aw)]/2Tr. In the limit as Tg — o, Aw — 0 and xTo(t) — 
x(t). Therefore 


x(t) = jim. x7(0) 


. l ~ , ijnAow 
dim, 57 D X(nd@)e’ A@ (7.6b) 


The sum on the right-hand side of Eq. (7.6b) can be viewed as the area under the function X(w),e/¥F, as illustrated in Fig. 7.3. 
Therefore 


1 aad 
x(t) = = / X(w)e!™ dw (7.7) 
vi Ua Ser 


X(w)e" 


Area Xindw eS 


j 
j 
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Q nAw 
Figure 7.3: The Fourier series becomes the Fourier integral in the limit as Tg > ©. 


The integral on the righteqnhand side is called the Fourier integral. We have now succeeded in representing an aperiodic signal x(t) by 
a Fourier integral (rather than a Fourier series).!T] This integral is basically a Fourier series (in the limit) with fundamental frequency Aw 
— 0, as seen from Eq. (7.6). The amount of the exponential einAwt is x (nQw)Aw/2tr. Thus, the function X(Ww) given by Eq. (7.3) acts 
as a spectral function. 


We call X (w) the direct Fourier transform of x(t), and x(t) the inverse Fourier transform of X(w). The same information is conveyed by 
the statement that x(t) and X(w) are a Fourier transform pair. Symbolically, this statement is expressed as 


X(w) = F[x(t)] and x(t) =F! [X(@)] 
or — 
x(t) <——> X(@) 


To recapitulate, 


wo 
X(@) =| x(the! at (7.8a) 
and 
| om 
x(t) = = | X(w)e"dw (7.8b) 
fan heer 


It is helpful to keep in mind that the Fourier integral in Eq. (7.8b) is of the nature of a Fourier series with fundamental frequency Aw 
approaching zero [Eq. (7.6b)]. Therefore, most of the discussion and properties of Fourier series apply to the Fourier transform as well. 
The transform X (Ww) is the frequency-domain specification of x(t). 


We can plot the spectrum X(w) as a function of w. Since X(w)is complex, we have both amplitude and angle (or phase) spectra 


X(@) = |X (w)|ei“*@ (7.9) 
in which |X(w)| is the amplitude and 2X(w) is the angle (or phase) of X(w). According to Eq. (7.8a), 
SO 
X(-—@) = | x(nedt 


—~oo 


Taking the conjugates of both sides yields 


x'(t) — X'(-@) (7.10) 


This property is known as the conjugation property. Now, if x(t) is a real function of f then x(f)=x*(t), and from the conjugation property, 
we find that 


X(—@) = X*(w) (7.11a) 


This is the conjugate symmetry property of the Fourier transform, applicable to real x(t). Therefore, for real x(t) 


|X(—@)| = |X()| (7.11b) 
£X(-—w) = —LX() (7.11c) 


Thus, for real x(t), the amplitude spectrum |X(w)| is an even function, and the phase spectrum 2X(w) is an odd function of w. These 
results were derived earlier for the Fourier spectrum of a periodic signal (Eq. (6.33)] and should come as no surprise. 


EXAMPLE 7.1 


Find the Fourier transform of e y(t), 
By definition [Eq. (7.8a)], 
~~ ~ 
X(@) = | e“u(the “dl =[ eet” = 
J 0 


oo 


as | 3 
e (at jw) 


a+ jo 0 


But |e /4| = 1. Therefore, as t — c0,e (@UW)t = e-at e-JWt = o if a < 0, but it is equal to 0 if a > 0. Therefore 


X(@) = ——— a>0O 
a+ jo 


F , lyf 
Expressing a + jw in the polar form as Ja? + @* e™ ye) we obtain 
! 


X(w) = : e~ itn (w/a) 
Jas + ay 
Therefore 
[X (w)| ; and = £X(w) = —tan~ (2) (7.12) 
e)| = ——= Z =— = 12 
Va? + a a 


The amplitude spectrum |X(uw)| and the phase spectrum 2X(w) are depicted in Fig. 7.4b. Observe that |X(w)| is an even function of 
w, and 2X(w) is an odd function of w, as expected. 


vit) Va |X(oo)] 
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Figure 7.4: e~ (t) and its Fourier spectra. 


EXISTENCE OF THE FOURIER TRANSFORM 

In Example 7.1 we observed that when a < 0, the Fourier integral for e ty(t) does not converge. Hence, the Fourier transform for 
e atu(t) does not exist if a < 0 (growing exponential). Clearly, not all signals are Fourier transformable. 

Because the Fourier transform is derived here as a limiting case of the Fourier series, it follows that the basic qualifications of the 


Fourier series, such as equality in the mean, and convergence conditions in suitably modified form apply to the Fourier transform as 
well. It can be shown that if x(t) has a finite energy, that is if 


/ Ix(t)|? dt < oo (7.13) 


no 
then the Fourier transform X(w) is finite and converges to x(t) in the mean. This means, if we let 


g(t) = lim — X(w)ei“ dw 
W+co 27 |_w 


then Eq. (7.8b) implies 


~ 
i Ix(t) — £2)? dt =0 (7.14) 


<* 


In other words, x(t) and its Fourier integral [the right-hand side of Eq. (7.8b)] can differ at some values of t without contradicting Eq. 


(7.14). We shall now discuss an alternate set of criteria due to Dirichlet for convergence of the Fourier transform. 


As with the Fourier series, if x(t) satisfies certain conditions (Dirichlet conditions), its Fourier transform is guaranteed to converge 
pointwise at all points where x(t) is continuous. Moreover, at the points of discontinuity, x(t) converges to the value midway between 
the two values of x(t) on either side of the discontinuity. The Dirichlet conditions are as follows: 


1. x(t) should be absolutely integrable, that is, 


= 
/ \x(t)| dt < co (7.15) 


mo 


If this condition is satisfied, we see that the integral on the right-hand side of Eq. (7.8a) is guaranteed to have a finite 
value. 


2. x(t) must have only finite number of finite discontinuities within any finite interval. 
3. x(t) must contain only finite number of maxima and minima within any finite interval. 


We stress here that although the Dirichlet conditions are sufficient for the existence and pointwise convergence of the Fourier transform, 
they are not necessary. For example, we saw in Example 7.1 that a growing exponential, which violates Dirichlet's first condition in 
(7.15) does not have a Fourier transform. But the signal of the form (sin at)/t, which does violate this condition, does have a Fourier 
transform. 


Any signal that can be generated in practice satisfies the Dirichlet conditions and therefore has a Fourier transform. Thus, the physical 
existence of a signal is a sufficient condition for the existence of its transform. 


LINEARITY OF THE FOURIER TRANSFORM 


The Fourier transform is linear; that is, if = 
xi(t) = > Xi{w) and x(t) => X2(@) 


then 


.X4 (0) + apxr(t) ——> a, X1(@) + apX2(w) (7.16) 


The proof is trivial and follows directly from Eq. (7.8a). This result can be extended to any finite number of terms. It can be extended to 
an infinite number of terms only if the conditions required for interchangeability of the operations of summation and integration are 
satisfied. 


7.1-1 Physical Appreciation of the Fourier Transform 


In understanding any aspect of the Fourier transform, we should remember that Fourier representation is a way of expressing a signal 
in terms of everlasting sinusoids (or exponentials). The Fourier spectrum of a signal indicates the relative amplitudes and phases of 
sinusoids that are required to synthesize that signal. A periodic signal Fourier spectrum has finite amplitudes and exists at discrete 
frequencies (Wg and its multiples). Such a spectrum is easy to visualize, but the spectrum of an aperiodic signal is not easy to visualize 
because it has a continuous spectrum. The continuous spectrum concept can be appreciated by considering an analogous, more 
tangible phenomenon. One familiar example of a continuous distribution is the loading of a beam. Consider a beam loaded with weights 
D1, D2, D3, ..., Dp units at the uniformly spaced points y4, yo, ..., Yn, aS shown in Fig. 7.5a. The total load W7 on the beam is given by 
the sum of these loads at each of the rn points: 

n 


Wr = >_> D, 
i=1 


Consider now the case of a continuously loaded beam, as depicted in Fig. 7.5b. In this case, although there appears to be a load at 
every point, the load at any one point is zero. This does not mean that there is no load on the beam. A meaningful measure of load in 
this situation is not the load at a point, but rather the loading density per unit length at that point. Let X(y) be the loading density per 
unit length of beam. It then follows that the load over a beam length Ay(Ay — 0), at some point y, is X(y)Ay.To find the total load on 
the beam, we divide the beam into segment of interval Ay(Ay — 0). The load over the nth such segment of length Ay is X(nAy)Ay. 
The total load Wz is given by 

Yn 


W; = lim. X(nAy) Ay 
Ay+0 
Mu 


Yn 
af X(y)dy 


(a) ib) 


Figure 7.5: Weight-loading analogy for the Fourier transform. 


The load now exists at every point, and y is now a continuous variable. In the case of discrete loading (Fig. 7.5a), the load exists only at 
the n discrete points. At other points there is no load. On the other hand, in the continuously loaded case, the load exists at every 
point, but at any specific point y, the load is zero. The load over a small interval Ay however, is [X(nAy)] Ay (Fig. 7.5b). Thus, even 
though the load a point y is zero, the relative load at that point is X(y). 


An exactly analogous situation exists in the case of a signal spectrum. When x(t) is periodic, the spectrum is discrete, and x(t) can be 
expressed as a sum of discrete exponentials with finite amplitudes: 
x() = 5” Dye 

nu 


For an aperiodic signal, the spectrum becomes continuous; that is, the spectrum exists for every value of w, but the amplitude of each 
component in the spectrum is zero. The meaningful measure here is not the amplitude of component of some frequency but the 


spectral density per unit bandwidth. From Eq. (7.6b) it is clear that x(t) is synthesized by adding exponentials of the form QlNAwt in 
which the contribution by any one exponential component is zero. But the contribution by exponentials in an infinitesimal band Aw 
located at w = nAw is (1/2Tt) X(nAw)Aw, and the addition of all these components yields x(t) in the integral form: 


(H= tim, = ps X(nAw)el"""" Aw = s [- X(w)e’™ dw (7.17) 
Thus, nAw approaches a continuous variable w. The spectrum now exists at every Ww. The contribution by components within a band 
dw is (1/21)X(w) du = X(uw)df, where df is the bandwidth in hertz. Clearly, X(w) is the spectral density per unit bandwidth (in 


hertz).[Tit also follows that even if the amplitude of any one component is infinitesimal, the relative amount of a component of 
frequency w is X(w). Although X(w) is spectral density, in practice it is customarily called spectrum of x(t) rather than the spectral 
density of x(t). Deferring to this convention, we shall call X(w) the Fourier spectrum (or Fourier transform) of x(t). 


A MARVELOUS BALANCING ACT 

An important point to remember here is that x(t) is represented (or synthesized) by exponentials or sinusoids that are everlasting (not 
causal). Such conceptualization leads to rather fascinating picture when we try to visualize the synthesis of time limited pulse signal x(t) 
[Fig. 7.6] by the sinusoidal components in its Fourier spectrum. The signal x(t) exists only over an interval (a, b) and is zero outside this 
interval. The spectrum x(t) contains an infinite number of exponentials (or sinusoids), which start at f= —oo and continue forever. The 
amplitudes and phases of these components add up exactly to x(t) over the finite interval (a, b) and the zero everywhere outside this 
interval. Juggling the amplitudes and phases of an infinite number of components to achieve such a perfect and delicate balance 
boggles the human imagination. Yet the Fourier transform accomplishes it routinely, without much thinking on our part. Indeed, we 
become so involved in mathematical manipulations that we fail to notice this marvel. 


x(t) 


a = b 


Figure 7.6: The marvel of the Fourier transform. 


[tlFor the sake of simplicity, we assume Dy, and therefore X(w), in Fig. 7.2, to be real. The argument, however, is also valid for 
complex Dy, [or X(u)]. 


[Fig nothing else, the reader now has irrefutable proof of the proposition that 0% ownership of everything is better than 100% ownership 
of nothing. 


[t]This derivation should not be considered to be a rigorous proof of Eq. (7.7). The situation is not as simple as we have made it 
[1] 
appear. 


[t]Churchill, R. V., and J. W. Brown, Fourier Series and Boundary Value Problems, 3rd ed. McGraw-Hill, New York, 1978. 


[TlTo stress that the signal spectrum is a density function we shall shade the plot of |X(w)| (as in Fig. 7.4b). The representation of 
ZX(w). however, will be a by a line plot, primarily to avoid confusion. 


7.2 TRANSFORMS OF SOME USEFUL FUNCTIONS 


For convenience, we now introduce a compact notation for the useful gate, triangle, and interpolation functions. 


UNIT GATE FUNCTION 
We define a unit gate function rect (x) as a gate pulse of unit height and unit width, centered at the origin, as illustrated in Fig. 7.7a tT]. 


o 


|x| > 


Nie 


rect (x) = [x| = (7.18) 


— 
NI NI tle 


|x| < 


The gate pulse in Fig. 7.7b is unit gate pulse rect (x) expended by a factor T along the horizontal axis and therefore can be expressed 
as rect (x/T) (see section 1.2-2). Observe that T, the denominator of the argument of rect (x/T), indicates the width of the pulse. 


rect (a) reat (2) 
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1 » i r lo Tt i> 
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Figure 7.7: A gate pulse. 


UNIT TRIANGLE FUNCTION 
We define a unit triangle function A(x) as triangular pulse of unit height and unit width, centered at the origin, as shown in Fig. 7.8a 


0 |x| = 
A(x) = 
t —2|x| |x| < 


The pulse in Fig. 7.8b is A(x/T). Observe that here, as for the gate pulse, the denominator Tt of the argument of A(x/T) indicates the 
pulse width. 


l ir |< . lo e ~~ 
2 2 2 2 


Figure 7.8: A triangle pulse. 


(7.19) 


Nis role 


INTERPOLATION FUNCTION sinc (x) 


The function sin x/x is the "sine over argument" function denoted by sinc (x)iT], This function plays an important role in signal 
processing. It is also known as the filtering or interpolating function. We define 


sinax 


sinc (x) = 
mx 
Inspection of Eq. (7.20) shows the following: 
1. sinc (x) is an even function of x. 


2. sinc (x) = 0 when sin x = 0 except at x = 0, where it appears to be indeterminate. This means that sinc x = 0 for x = +p, 
+2p,+3p.,.... 


3. Using L'H6pital's rule, we find sinc (0) = 1. 


4. sinc (x) is the product of an oscillating signal sin x (of period 21) and a monotonically decreasing function 1/x. Therefore, 
sinc (x) exhibits damped oscillations of period 21r, with amplitude decreasing continuously as 1/x. 


Figure 7.9a shows sinc (x). Observe that sinc (x) = 0 for values of x that are positive and negative integer multiples of tr. Figure 7.9a 
shows sinc (3w/7). The argument 3u/7 = T when w = 711/3. Therefore, the first zero of this function occurs at w = 7T1/3. 


=|— 


sane (x) 


Figure 7.9: A sinc pulse. 


EXERCISE E7.1 


Sketch: 

a. rect (x/8) 

b. A(vs/10) 

c. sinc (3TTWw/2) 

d. sinc (ft) rect (t/41r) 
EXAMPLE 7.2 


Find the Fourier transform of x(t) = rect (t/T) (fig. 7.10a). 
oo 
t ; 
X(@) = / rect (<) e "dt 
=o Tt 


“ 


Figure 7.10: (a) A gate pulse x(f), (b) its Fourier spectrum X(w), (c) its amplitude spectrum |X(w)|, and (d) its phase spectrum 
ZX(w). 


Sinc rect (t/T) = 1 for |¢| < T/2, and since it is zero for |t| > T/2, 


r/2 
X(@) = | e “at 


t/2 


WT 
2 si — 

1 a 2sin ( A ) 
——(e jwr/2 efwr/2) = & 


J @ @ 


. MT 
sm | — 
2 ’ @T 
—— = “TSINC 


Therefore 


t 
reet(~) <=> T sine($*) (7.21) 
Tv 2 


Recall that sinc(x) = 0 when x = ntTt. Hence, sinc (WwT/2) = 0 when wt/2 = +nTr; that is, when w = +2ntTt/T, (n = 1, 2, 3, ...) as 
depicted in Fig. 7.10b. The Fourier transforms X(w) shown in Fig. 7.10b exhibits positive and negative values. A negative amplitude 
can be considered to be a positive amplitude with a phase of —tr or tr. We use this observation to plot the amplitude spectrum |X(w)| 
= |sinc (wT/2)| (Fig. 7.10c) and the phase spectrum 2X(w) (Fig. 7.10d). The phase spectrum, which is required to be an odd function 
of w, may be draen is several other ways because a negative sign can be accounted for by a phase of tntr, where n is any odd 
integer. All such representations are equivalent. 


BANDWIDTH OF rect (¢/T) 


The spectrum X(w) in fig. 7.10 peaks at w = 0 and decays at higher frequencies. Therefore, rect (t/T) is a lowpass signal with most of 
the signal energy in lower-frequency components. Strictly speaking, because the spectrum extends from 0 to o. The bandwidth is oo. 
However, must of the spectrum is concentrated within first lobe (from w = 0 to w = 2Tt/T). Therefore, a rough estimate of the 
bandwidth of a rectangular pulse of width T seconds is 2tTt/T rad/s, or 1/tau HzIt]_ Note the reciprocal relationship of the pulse width 
with its bandwidth. We shall observe later that this result is true in general. 


EXAMPLE 7.3 
Find the Fourier transform of the unit impulse 8(t). 


Using the sampling property of the impulse [Eq. (1.24)], we obtain 


F[d(t)] = if &(the “dt = 1 (7.22a) 
or 
d(t) <> 1 (7.22b) 
Figure 7.11 shows 8(t) and its spectrum. 
x(t) = 6(0) X(w) = 1 
1 
<=> 


0 i~_ 0 o> 
(a) (b) 


Figure 7.11: (a) Unit impulse and (b) its Fourier spectrum. 


EXAMPLE 7.4 


Find the inverse Fourier transform of 8(w). 
On the basis of Eq. (7.8b) and the sampling property of the function, 
i oe 
F-'[8(@)] =— 5(w)e!" dw = — 
2n 2x 


oo 


Therefore 


<=> 5(w) (7.23a) 


Qn 
or 
1 — > 278(w) (7.23b) 
x)= 1 | X(co) ~ 2ar8(a) 
i =—_ 


o| ‘> 0| o> 
fa) {b) 
Figure 7.12: (a) A constant (dc) signal and (b) its Fourier spectrum. 
This result shows that the spectrum of a constant signal x(t) = 1 is an impulse 21r6(w)), as illustrated in Fig. 7.12. 
The result [Eq. (7.23b)] could have been anticipated on qualitative grounds. Recall that the Fourier transform of x(t) is a spectral 


representation of x(t) in term of everlasting exponential components of the form elt. Now, to represent a constant signal x(t) = 1 we 


need a single everlasting exponential e/”! with w = 0.!T]. This result in spectrum at a single frequency w = 0. Another way of looking at 
the situation is that x(t) = 1 is a de signal which has a single frequency w = 0 (dc). 


If an impulse at w = 0 is a spectrum of a dc signal, what does an impulse at W = Wo represent? We shall answer this question in the 
next example. 


ariciiieteS . . oe 


Find the inverse Fourier transform of 5(w — Ww). 


Using the sampling property of the impulse function, we obtain 
oO 


1 . [ . 

F[S(@ —w)|}=— | 8(@ —an)el™ do = —ei™ 

2K Ton 2x 
Therefore 
© in 
—eion => b(w — @p) 
2x 
or 


ei! 2» In3(w — @y) (7.24a) 


This result shows that the spectrum of an everlasting exponential e/”* is signal impulse at w = Wo. We reach the same conclusion by 


qualitative reasoning. To represent the everlasting exponential ot, we need a single everlasting exponentials et with w = Wo. 
Therefore, the spectrum consists of a single component at frequency Ww = Wo. 


From Eq. (7.24a) it follows that 


ei ss I 5(w + wy) (7.24b) 


EXAMPLE 7.6 
Find the Fourier transforms of the everlasting sinusoid cos Wof (Fig. 7.13a). 


wif) Oe of X(w) ad 


= 


fa) {b) 


Figure 7.13: (a) A cosine signal and (b) its Fourier spectrum. 


Recall the Euler formula 
COS Mol = 1 (een! +e jaot 


Adding Eqs. (7.24a) and (7.24b), and using the foregoing result, we obtain 


COS Wot <> m[5(@ + &o) + 5(@ — @)] (7.25) 


The spectrum of cos Wof consists of two impulses at Wo and —W0g, as shown in Fig. 7.13b. The result also follows from qualitative 


reasoning. An everlasting sinusoid cos wot can be synthesized by two everlasting exponentials, e/“o! and e/“o!. Therefore the Fourier 
spectrum consists of only two components of frequencies Wo and —Wg. 


EXAMPLE 7.7: (Fourier Transform of a Periodic Signal) 


We can use a Fourier series to express a periodic signal as a sum of a sum of exponentials of the form e/M®ot whose Fourier transform 
is found in Eq. (7.24a). Hence, we can readily find the Fourier transform of a periodic signal by using the linearity property in Eq. (7.16). 


The Fourier series of a periodic signal x(t) with period To is given by 
x 

F 2x 

H= p> De w= 

Mis ad T 


n=—oo 


Taking the Fourier transform of both sides, we obtain!t] 


X(w) =22 S~ D,8(@ — na) (7.26) 


Aa=-—8O 


EXAMPLE 7.8: (Fourier Transform of a Unit Impulse Train) 
The Fourier series for the unit impulse train 57,(t), shown in Fig. 7.14a, was found in Example 6.7. The Fourier coefficient D,, for this 


signal, as seen from Eq. (6.37), is a constant D, = 1/To. 
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Figure 7.14: (a) The uniform impulse train and (b) its Fourier transform. 
From Eq. (7.26), the Fourier transform for the unit impulse train is 


x = 
X(@) = = > 5(@ — N@) @ = 


0 n=-o0 


= MS an(@) (7.27) 


2x 
To 


The corresponding spectrum is shown in Fig. 7.14b. 


EXAMPLE 7.9 


Find the Fourier transform of the unit step function u(t). 


Trying to find the Fourier transform of u(t) by direct integration leads to an indeterminate result because 
oo . Oo ; —] ~ 
U(w) = / u(te "di = | e “dt = —e al 
. 0 


jo@ 6 


The upper limit of e/! as t — o yields an indeterminate answer. So we approach this problem by considering u(t) to be a decaying 
exponential e y(t) in the limit as a — 0 (Fig. 7.15a). Thus 
u(t) = lime “ u(t) 

a— 


and 


U(w) = lim Fle~™ u(t)} = lim (7.28a) 


a0 a+ jw 
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Figure 7.15: Derivation of the Fourier transform of the step function. 


Expressing the right-hand side in terms of its real and imaginary parts yields 


B a @ 
a0 La* + w* a*+w* 


The function al(a? + w?) has interesting properties. First, the area under this function (Fig. 7.15b) is tt regardless of the value of a: 
a ,o|~ 
Cae oak dw = tan — => 
~ a +o B | on 


Second, when a — 0, this function approaches zero for all w +# 0, and all its area (tr) is concentrated at a single point w = 0. Clearly, 
as a — 0, this function approaches an impulse of strength T!t]. Thus 


l 
U(@) = 78(w) + — (7.29) 
jw 


Note that u(t) is not a "true" dc signal because it is not constant over the interval — oo to oo. To synthesize a "true" dc, we require only 
one everlasting exponential with w = 0 (impulse at w = 0). The signal u(t) has a jump discontinuity at f = 0. It is impossible to 
synthesize such a signal with a single everlasting exponential Xt To synthesize this signal from everlasting exponentials, we need, in 
addition to an impulse at w = 0, all the frequency components, as indicated by the term 1/jw in Eq. (7.29). 


EXAMPLE 7.10 


Find the Fourier transform of the sign function sgn (t) [pronounced signum (t)], depicted in Fig. 7.16. 


sgn (f) 


Figure 7.16 


Observe that 
son(f)+1—2u(t) = > sgn(t) = 2u(t)— 1 


Using the results in Eqs. (7.23b), (7.29), and the linearity property, we obtain 


2 
sen (t) <> — (7.30) 


J@ 


EXERCISE E7.2 


Show that the inverse Fourier transform of X(w) illustrated in Fig. 7.17 is x(t) = (Wo/TTt) sinc (Wot). Sketch x(?). 


X(w) 


On o> On 
Figure 7.17 


EXERCISE E7.3 
Show that cos (wot + 8) <=> T1[5(w + wo)e® + &(w — wo)e/}. 


7.2-1 Connection Between the Fourier and Laplace Transforms 


The general (bilateral) Laplace transform of a signal x(t), according to Eq. (4.1) is 


x 
X(s) = : x(t)e" dt (7.3 1a) 


oo 


Setting s = jw in this equation yields 


oo 
x(jo) = | x(ne dt (7.31b) 


ao 


where X(jw) = X(S)|s = jw. But, the right-hand-side integral defines X(w), the Fourier transform of x(t). Does this mean that the Fourier 
transform can be obtained from the corresponding Laplace transform by setting s = jw? In other words, is it true that X(jw) = X(w)? 
Yes and no. Yes, it is true in most cases. For example, when x(t) = e~* u(t), its Laplace transform is 1/(s + a), and X(jw) = 1/(jw + a), 
which is equal to X(w) (assuming a < 0). However, for the unit step function u(t), the Laplace transform is 


utes : Res > 0 


The Fourier transform is given by 


I ' 
u(t) —> — + 745(@) 
jo 


Clearly, X(jw) # X(w) in this case. 


To understand this puzzle, consider the fact that we obtain X(jw) by setting s = jw in Eq. (7.31a). This implies that the integral on the 
right-hand side of Eq. (7.31a) converges for s = jw, meaning that s = jw (the imaginary axis) lies in the ROC for X(s). The general rule 
is that only when the ROC for X(s) includes the jw axis, does setting s = jw in X(s) yield the Fourier transform X(u), that is, X(jw) = 
X(w). This is the case of absolutely integrable x(t). If the ROC of X(s) excludes the jw axis, X(jw) # X(w). This is the case for 
exponentially growing x(t) and also x(t) that is constant or is oscillating with constant amplitude. 

The reason for this peculiar behavior has something to do with the nature of convergence of the Laplace and the Fourier integrals when 
x(t) is not absolutely integrable.!T] 


This discussion shows that although the Fourier transform may be considered as a special case of the Laplace transform, we need to 
circumscribe such a view. This fact can also be seen from the fact that a periodic signal has the Fourier transform, but the Laplace 
transform does not exist. 


[Tat |x| = 0.5, we require rect (x) = 0.5 because the inverse Fourier transform of a discontinuous signal converges to the mean of its 
two values at the discontinuity. 


[Tlsinc(x) is also denoted by Sa (x) in the literature. Some authors define sinc (x) as 


sinc (x) = =~ (7.20) 


[tT compute bandwidth, we must consider the spectrum only for positive values of w. See discussion in Section 6.3. 


[t]The constant multiple 211 in the spectrum [X(w) = 211&(w))] may be a bit puzzling. Since 1 = e/”* with w = 0, it appears that the 


Fourier transform of x(t) = 1 should be an impulse of strength unity rather than 2Tr. Recall, however, that in the Fourier transform x(t) is 
synthesized by exponentials not of amplitude X(nAw)Aw but of amplitude 1/211 times X(nAw)Aw, as seen from Eq. (7.66b). Had we 
used variable f (hertz) instead of w, the spectrum would have been the unit impulse. 


[tlWe assume here that the linearity property can be extended to an infinite sum. 


[tlThe second term on the right-hand side of Eq. (7.28b), being an odd function of w, has zero area regardless of the value of a. As a 
— 0, the second term approaches 1/v. 


[tT explain this point, consider the unit step function and its transforms. Both the Laplace and the Fourier transform synthesize x(f), 


using everlasting exponentials of the form eS! The frequency s can be anywhere in the complex plane for the Laplace transform, but it 
must be restricted to the jw axis in the case of the Fourier transform. The unit step function is readily synthesized in the Laplace 
transform by a relatively simple spectrum X(s) = 1 /s, in which the frequencies s are chosen in the RHP [the region of convergence for 
u(t) is Re s > O]. In the Fourier transform, however, we are restricted to values of s only on the jw axis. The function u(t) can still be 
synthesized by frequencies along the jw axis, but the spectrum is more complicated than it is when we are free to choose the 
frequencies in the RHP. In contrast, when x(t) is absolutely integrable, the region of convergence for the Laplace transform includes the 
jw axis, and we can synthesize x(t) by using frequencies along the jw axis in both transforms. This leads to X(jw) = X(w). 


We may explain this concept by an example of two countries, X and Y. Suppose these countries want to construct similar dams in their 
respective territories. Country X has financial resources but not much manpower. In contrast, Y has considerable manpower but few 
financial resources. The dams will still be constructed in both countries, although the methods used will be different. Country X will use 
expensive but efficient equipment to compensate for its lack of manpower, whereas Y will use the cheapest possible equipment in a 
labor-intensive approach to the project. Similarly, both Fourier and Laplace integrals converge for u(t), but the make-up of the 
components used to synthesize u(t) will be very different for two cases because of the constraints of the Fourier transform, which are 
not present for the Laplace transform. 


7.3 SOME PROPERTIES OF THE FOURIER TRANSFORM 


We now study some of the important properties of the Fourier transform and their implications as well as applications. We have already 
encountered two important properties, linearity [Eq. (7.16)] and the conjugation property [Eq. (7.10)]. 


Before embarking on this study, we shall explain an important and pervasive aspect of the Fourier transform: the time-frequency duality. 


x 
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Figure 7.18: A near symmetry between the direct and the inverse Fourier transforms. 
TIME-FREQUENCY DUALITY IN THE TRANSFORM OPERATIONS 


Equations (7.8) show an interesting fact: the direct and the inverse transform operations are remarkably similar. These operations, 
required to go from x(t) to X(w) and then from X(w) to x(t), are depicted graphically in Fig. 7.18. The inverse transform equation can be 
obtained from the direct transform equation by replacing x(t) with X(w), ¢ with w, and w with ¢. In a similar way, we can obtain the 
direct from the inverse. There are only two minor differences in these operations: the factor 2T appears only in the inverse operator, 


and the exponential indices in the two operations have opposite signs. Otherwise the two equations are duals of each other.[t] This 
observation has far-reaching consequences in the study of the Fourier transform. It is the basis of the so-called duality of time and 
frequency. The duality principle may be compared with a photograph and its negative. A photograph can be obtained from its negative, 
and by using an identical procedure, a negative can be obtained from the photograph. For any result or relationship between x(t) and 
X(uo), there exists a dual result or relationship, obtained by interchanging the roles of x(t) and X(w) in the original result (along with 
some minor modifications arising because of the factor 21 and a sign change). For example, the time-shifting property, to be proved 
later, states that if x(t) <= X(uv), then 


X(t — fo) => X(@)e"** 
The dual of this property (the frequency-shifting property) states that 


x(tei! <> X(w — wo) 


Observe the role-reversal of time and frequency in these two equations (with the minor difference of the sign change in the exponential 
index). The value of this principle lies in the fact that whenever we derive any result, we can be sure that it has a dual. This possibility 
can give valuable insights about many unsuspected properties or results in signal processing. 


The properties of the Fourier transform are useful not only in deriving the direct and inverse transforms of many functions, but also in 
obtaining several valuable results in signal processing. The reader should not fail to observe the ever-present duality in this discussion. 


LINEARITY 
The linearity property [Eq. (7.16)] has already been introduced. 


CONJUGATION AND CONJUGATE SYMMETRY 
The conjugation property, which has already been introduced, states that if x(t) <= X(w), then 
x*(t) <== X*(-o@) 


From this property follows the conjugate symmetry property, also introduced earlier, which states that if x(t) is real, then 


X(—@w) = X*(@) 
DUALITY 


The duality property states that if 
x(t) <= > X(@) 
then 
X(t) = > 22 x(-«w) (7.32) 
Proof. From Eq. (7.8b) we can write 
x 


l 
x(t) = — X (ue du 
2x 


—m 


Hence 


~ 
anx(—t) = | X(uje™ du 


Changing ¢ to w yields Eq. (7.32). 


EXAMPLE 7.11 
In this example we apply the duality property [Eq. (7.32)] to the pair in Fig. 7.19a. 
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Figure 7.19: The duality property of the Fourier transform. 


From Eq. (7.21) we have 
t - WT 
rect | — |} => TSsinc | — 
Tt 2 
x(t) X(a) 


Also, X(t) is the same as X(w) with w replaced by t, and x(—w) is the same as x(t) with ft replaced by —w. Therefore, the duality 
property (7.32) yields 


7 Tl — a@ 
T since ($) <> 2n rect (=) = 2n rea(*) (7.33) 
Smad —S 


Xir) 2ax(—w) 


In Eq. (7.33) we used the fact that rect (—x) = rect (x) because rect is an even function. Figure 7.19b shows this pair graphically. 
Observe the interchange of the roles of t and w (with the minor adjustment of the factor 21r). This result appears as pair 18 in Table 
7.1 (with T/2 = W). 


As an interesting exercise, the reader should generate the dual of every pair in Table 7.1 by applying the duality property. 


Table 7.1: Fourier Transforms 
= Open table as spreadsheet 


———— 


2 

i 
ee 
To 


————— 
7 2718(w) 
8 =—— 2718(W—Wo) 
9 COS Wot Tr[S(Wd — Wo) + (Ww + Wo)] 


10 sin [ sinwot | | sm[8(w + wo) — B(W— wo) | + Wo) — — Wo)] 


11 ae x5(o) +5 E32 
12 sgnt 


13 cos Wof u(t) 


5 [so - @o) + 8(@ + @)] +s 


15 atsin Wot u(t) 
(a (a+ joy +o2 ree oF 
atcos Wot u(t) te 
(a+ jo)* + we 


t wT 
oe rect (=) T sinc z 
Tt 


1 ~ sine (W1) rect (—) 
19 ; 
A ( (-) = sinc” (=) 
ee || 


fa“) 
Wp >, 5(@ — Nao) 


a=—o 


EXERCISE E7.4 
Apply the duality property to pairs 1, 3, and 9 (Table 7.1) to show that 


a. 1/(jt + a) <> 2Tre?” u(—w) 

b. 2al(t2 + a2) <= 271 e all 

c. O(t + to) + O(t — to) <=> 2 cos tow 
THE SCALING PROPERTY 


if 
x(t) <—> X(o) 


then, for any real constant a, 


I a 
x(at) <> —X (=) (7.34) 
ja| a 


Proof. For a positive real constant a, 


F[x(at)] = / x(at)e?™ dt 


i> 4) 


1 oo =e 1 
= “| x(ujeI°/™ du = —X (=) 
a Joo a a 


Similarly, we can demonstrate that if a < 0, 


—1 @ 
x(at) = — X | — 
a a 


Hence follows Eq. (7.34). 
SIGNIFICANCE OF THE SCALING PROPERTY 


The function x(at) represents the function x(t) compressed in time by a factor a (see Section 1.2-2). Similarly, a function X(w/a) 
represents the function X(Ww) expanded in frequency by the same factor a. The scaling property states that time compression of a signal 
results in its spectral expansion, and time expansion of the signal results in its spectral compression. \ntuitively, compression in time by 


factor a means that the signal is varying faster by factor a.'t] To synthesize such a signal, the frequencies of its sinusoidal components 
must be increased by the factor a, implying that its frequency spectrum is expanded by the factor a. Similarly, a signal expanded in 
time varies more slowly; hence the frequencies of its components are lowered, implying that its frequency spectrum is compressed. For 
instance, the signal cos 2 Wot is the same as the signal cos Wof time-compressed by a factor of 2. Clearly, the spectrum of the former 
(impulse at +2Wg) is an expanded version of the spectrum of the latter (impulse at +W). The effect of this scaling is demonstrated in 
Fig. 7.20. 


Figure 7.20: The scaling property of the Fourier transform. 
RECIPROCITY OF SIGNAL DURATION AND ITS BANDWIDTH 


The scaling property implies that if x(t) is wider, its spectrum is narrower, and vice versa. Doubling the signal duration halves its 
bandwidth, and vice versa. This suggests that the bandwidth of a signal is inversely proportional to the signal duration or width (in 


seconds).|T] We have already verified this fact for the gate pulse, where we found that the bandwidth of a gate pulse of width T 
seconds is 1/tT Hz. More discussion of this interesting topic can be found in the literature. !21 


By letting a = —1 in Eq. (7.34), we obtain the inversion property of time and frequency: 


x(-t) => X(-o) (7.35) 


EXAMPLE 7.12 


Find the Fourier transforms of e@tu(—t) and e7@lél, 


Application of Eq. (7.35) to pair 1 (Table 7.1) yields 


e' u(—t) => —— a>o 
a— jo 
Also 
el = ey (t) + e“u(—t) 
Therefore 
1 1 2 
ee ee a et (7.36) 


Figure 7.21 


(a) elt! and (b) its Fourier spectrum. 


THE TIME-SHIFTING PROPERTY 
If 

x(t) —> X(o) 

then 


x(t — &) —=> X(w)e*” (7.37a) 
Proof. By definition, 


. 


Fi[x(t -_ to)] = / x(t = fei" dt 


—no 


Letting t — tg = u, we have 


co 
Flx(t —t)] -/ x(we 2" du 


=@e a x(uje" 2" du = X(w)e i" (7.37b) 


This result shows that delaying a signal by tg seconds does not change its amplitude spectrum. The phase spectrum, however, is 
changed by — wip. 


PHYSICAL EXPLANATION OF THE LINEAR PHASE 

Time delay in a signal causes a linear phase shift in its spectrum. This result can also be derived by heuristic reasoning. Imagine x(t) 
being synthesized by its Fourier components, which are sinusoids of certain amplitudes and phases. The delayed signal x(t — tg) can 
be synthesized by the same sinusoidal components, each delayed by tg seconds. The amplitudes of the components remain 
unchanged. Therefore, the amplitude spectrum of x(t — fg) is identical to that of x(t). The time delay of fo in each sinusoid, however, 
does change the phase of each component. Now, a sinusoid cos wt delayed by fo is given by 

cos w (f — fo) = cos (wt — wl) 


Figure 7.22: Physical explanation of the time-shifting property. 


Therefore a time delay fg in a sinusoid of frequency w manifests as a phase delay of wig. This is a linear function of w, meaning that 
higher-frequency components must undergo proportionately higher phase shifts to achieve the same time delay. This effect is depicted 
in Fig. 7.22 with two sinusoids, the frequency of the lower sinusoid being twice that of the upper. The same time delay fp amounts to a 
phase shift of tr/2 in the upper sinusoid and a phase shift of Tr in the lower sinusoid. This verifies the fact that to achieve the same time 
delay, higher-frequency sinusoids must undergo proportionately higher phase shifts. The principle of linear phase shift is very important, 
and we shall encounter it again in distortionless signal transmission and filtering applications. 


EXAMPLE 7.13 
Find the Fourier transform of e~@!f-f5], 
This function, shown in Fig. 7.23a, is a time-shifted version of e~@!/l (depicted in Fig. 7.21a). From Eqs. (7.36) and (7.37) we have 


at—h 2a Jato 
ena) gy, ——_¢ (7.38) 
a~ + w- 


The spectrum of ealt—tol (Fig. 7.23b) is the same as that of ealtl (Fig. 7.21b), except for an added phase shift of —wifp. 


Observe that the time delay tg causes a linear phase spectrum —Wwig. This example clearly demonstrates the effect of time shift. 


» 


Figure 7.23: Effect of time-shifting on the Fourier spectrum of a signal. 


EXAMPLE 7.14 
Find the Fourier transform of the gate pulse x(f) illustrated in Fig. 7.24a. 


The pulse x(t) is the gate pulse rect (t/T) in Fig. 7.10a delayed by 31/4 second. Hence, according to Eq. (7.37a), its Fourier transform 


—juo(3T/4) 


is the Fourier transform of rect (t/T) multiplied by e . Therefore 


« BE ng 
X(w) = T sinc a e~ier/4) 


The amplitude spectrum |X(uw)| (depicted in Fig. 7.24b) of this pulse is the same as that indicated in Fig. 7.10c. But the phase spectrum 
has an added linear term —3wt/4. Hence, the phase spectrum of x(t) (Fig. 7.24a) is identical to that in Fig. 7.10d plus a linear term 
—3wT/4, as shown in Fig. 7.24c. 


PHASE SPECTRUM USING PRINCIPAL VALUES 


There is an alternate way of spectral representation of 7X(w). The phase angle computed on a calculator or by using a computer 
subroutine is generally the principal value (modulo 211 value) of the phase angle, which always lies in the range —TTr to Tr. For instance, 
the principal value of angle 31t/2 is —tt/2, and so on. The principal value differs from the actual value by +21 radians (and its integer 
multiples) in a way that ensures that the principal value remains within —tTr to Tr. Thus, the principal value will show jump 
discontinuities of +27 whenever the actual phase crosses +11. The phase plot in Fig. 7.24c is redrawn in Fig. 7.24d using principal 
value for the phase. This phase pattern, which contains phase discontinuities of magnitudes 2Tt and Tr, becomes repetitive at intervals 
of w = 8Tt/T. 


Xies) (peincipal value) 


Figure 7.24: Another example of time-shifting and its effect on the Fourier spectrum of a signal. 


EXERCISE E7.5 


Use pair 18 of Table 7.1 and the time-shifting property to show that the Fourier transform of sinc[w(t — 7)] is (Two) rect 
(w/2w9)e JT, Sketch the amplitude and phase spectra of the Fourier transform. 
THE FREQUENCY-SHIFTING PROPERTY 
If > r 5 
x(t) — > X(o) 
then 

x(tyel™" <> X(w — a) (7.39) 
Proof. By definition, 

oO ~~ 

Flx(pe"] -/ x(nHe"e™ dt -/ x(ne Ft" dt = X(w — a) 


- -o9 


According to this property, the multiplication of a signal by a factor e/ol shifts the spectrum of that signal by w = Wo. Note the duality 
between the time-shifting and the frequency-shifting properties. 


Changing Wo to — Wo in Eq. (7.39) yields 


x(e i" <> X(w + wo) (7.40) 


Because e/“o! is not a real function that can be generated, frequency shifting in practice is achieved by multiplying x(t) by a sinusoid. 
Observe that 


X(t) COS Wolf = 4[x (tel! + x(Ner"] 
From Eqs. (7.39) and (7.40), it follows that 
X(1) COS ant —> 1X(w — Wy) + X(@ + a)] (7.41) 


This result shows that the multiplication of a signal x(t) by a sinusoid of frequency Wg shifts the spectrum X(Ww) by +Wo, as depicted in 
Fig:. 7.25: 


(4) 


Figure 7.25: Amplitude modulation of a signal causes spectral shifting. 


Multiplication of a sinusoid cos Wot by x(t) amounts to modulating the sinusoid amplitude. This type of modulation is known as 
amplitude modulation. The sinusoid cos Woft is called the carrier, the signal x(t) is the modulating signal, and the signal x(t) cos Wot is 
the modulated signal. Further discussion of modulation and demodulation appears in Section 7.7. 


To sketch a signal x(t) cos Wot, we observe that 
x(t) when COS @of = | 
X(t) COS @pt = 
—x(t) when cos @of = —1 
Therefore, x(t) CoS Wot touches x(t) when the sinusoid cos Wof is at its positive peaks and touches — x(t) when cos Wof is at its 
negative peaks. This means that x(t) and —x(t) act as envelopes for the signal x(t) cos Wot (see Fig. 7.25). The signal —x(f) is a mirror 
image of x(t) about the horizontal axis. Figure 7.25 shows the signals x(t) and x(t) cos Wof and their spectra. 


EXAMPLE 7.15 : : 
Find and sketch the Fourier transform of the modulated signal x(t) cos 10f in which x(t) is a gate pulse rect (t/4) as illustrated in Figure 
7.26a. 


fed d 


Figure 7.26: An example of spectral shifting by amplitude modulation. 


From pair 17 (Table 7.1) we find rect (t/4) <= 4 sinc (2w), which is depicted in Fig. 7.26b. From Eq. (7.41) it follows that 
x(t) cos 10f <=> $[X(@ + 10) + X(w — 10)] 


In this case, X(w) = 4 sinc (2w). Therefore 
x(t) cos 10 <=> 2 sinc [2(@ + 10)] + 2 sinc [2(@ — 10)] 
The spectrum of x(t) cos 10¢ is obtained by shifting X(w) in Fig. 7.26b to the left by 10 and also to the right by 10, and then multiplying 


it by 0.5, as depicted in Fig. 7.26d. 


EXERCISE E7.6 


Show that 


X(t} COs (wot +0) <=> 4[X(@ — woe!” + X(@ + ane? 


EXERCISE E7.7 


1. Sketch signal e7l!l cos 10t. Find the Fourier transform of this signal and sketch its spectrum. + 
Answers 
4, 1 | 
X(w) = ——__ + ——__. 
X(w) = (»—10)?+1 (w+10)?+1 


See Fig. 7.21b for the spectrum of e~@lél, 


APPLICATION OF MODULATION 
Modulation is used to shift signal spectra. Some of the situations that call for spectrum shifting are presented next. 


1. 


If several signals, all occupying the same frequency band, are transmitted simultaneously over the same transmission 
medium, they will all interfere; it will be impossible to separate or retrieve them at a receiver. For example, if all radio 
stations decide to broadcast audio signals simultaneously, a receiver will not be able to separate them. This problem is 
solved by using modulation, whereby each radio station is assigned a distinct carrier frequency. Each station transmits a 
modulated signal. This procedure shifts the signal spectrum to its allocated band, which is not occupied by any other 
station. A radio receiver can pick up any station by tuning to the band of the desired station. The receiver must now 
demodulate the received signal (undo the effect of modulation). Demodulation therefore consists of another spectral shift 
required to restore the signal to its original band. Note that both modulation and demodulation implement spectral shifting; 
consequently, demodulation operation is similar to modulation (see Section 7.7). 


This method of transmitting several signals simultaneously over a channel by sharing its frequency band is known as 
frequency-division multiplexing (FDM). 


He claims this method 
incorporates the best 
of two older methods. 


A _ 
Eastern Telecom. Co. me Lites is Techeoter" 


Old is gold, bet sometimes it is fool's gold. 


Old is gold, but sometimes it is fool's gold. 


. For effective radiation of power over a radio link, the antenna size must be of the order of the wavelength of the signal to 


be radiated. Audio signal frequencies are so low (wavelengths are so large) that impracticably large antennas would be 
required for radiation. Here, shifting the spectrum to a higher frequency (a smaller wavelength) by modulation solves the 
problem. 


CONVOLUTION 


The time-convolution property and its dual, the frequency-convolution property, state that if 
nit) <— > Xi(w) = and —s axa (t) > X2(@) 


then 


x(t) «x2(t) — > X(@)Xx(@) (time convolution) (7.42) 


and 


1 
x, (x(t) — Fy kilo) # X2(w) (frequency convolution) (7.43) 


Proof. By definition 


F\x,(t) *x2(t)| -/ e ie / X1(T)x2(t — nar| dt 


—oO —0o 


-/ x(t) i eMtay(t —1)dr| dt 


The inner integral is the Fourier transform of Xa(t — T), given by [time-shifting property in Eq. (7.37)] Xo(w)e JOT, Hence 
Flay) ex2t)] =[ x(t )e7!"" X3(w) dr = X; to) fs (re "dr = Xy(w)X(w) 


Let H(w) be the Fourier transform of the unit impulse response h(t), that is 


h(t) <=> H(o) (7.44a) 
Application of the time-convolution property to y(t) = x(t)*h(t) yields (assuming that both x(t) and A(t) are Fourier transformable) 
Y(w) = X(w)H(o) (7.44b) 


The frequency-convolution property (7.43) can be proved in exactly the same way by reversing the roles of x(t) and X(w). 


EXAMPLE 7.16 
Use the time-convolution property to show that if 
x(t) = > X(@) 
then 
; X(w) 
x(t) dt — —_ + 7X (0)4(m) (7.45) 
~<o Jo 


Because 


1 = 
utr) =f 4 tt 


it follows that 


rneue) =f x(ryutt—1)dt = f x(t)dt 


oo oo 


Now, from the time-convolution property [Eq. (7.42)], it follows that 
i 


1 
rinaucy = | x(t)dt = > X(@) = +78(0)| 


= — + 2X (0)5(w) 


In deriving the last result, we used Eq. (1.23a). 


EXERCISE E7.8 
Use the time-convolution property to show that x(t)* 5(t) = x(t). 


EXERCISE E7.9 
Use the time-convolution property to show that 


eult)xe u(t) = fe" —e" Juct) 

eel eS Re eee" 
TIME DIFFERENTIATION AND TIME INTEGRATION 

If 

x(t) <=> X(@) 


then 


cad <=> jwX(w) (time differentiation)! (7.46) 


[tT] 


and 
" X(w) — . 
x(t)dt = "ta +2X(0)8(w) (time integration) (7.47) 
-20 7) 


Proof. - ee of both sides of Eq. (7.8b) yields 


= = =|. j@X (we! da 


This result shows that 


=. <=> joX (a) 


Repeated application of this property yields 
d"x 
di" 


Table 7.2: Fourier Transform Operations 
= Open table as spreadsheet 


[Conjugation fx) TX -w) 
[ siuality TX) x(-w) 


Scaling (a real) x(at) 


Time shifting x(t — fo) 


<=> (jw)"X(@) (7.48) 


Frequency shifting (Wo real) x(t)e/ot 
j Time convolution aa" 200 _| 


Frequency convolution x4(t)Xo(t) ] 
Qn 
Time differentiation 
dt" 


Time integration Jt_.x(u)du 


The time-integration property [Eq. (7.47)] has already been proved in Example 7.16. 
The Fourier transform properties are summarized in Table 7.2. 


EXAMPLE 7.17 
Use the time-differentiation property to find the Fourier transform of the triangle pulse A(¢/T) illustrated in Fig. 7.27a. 


(c) 
Figure 7.27: Finding the Fourier transform of a piecewise-linear signal using the time-differentiation property. 


To find the Fourier transform of this pulse we differentiate the pulse successively, as illustrated in Fig. 7.27b and 7.27c. Because dx/dt 


is constant everywhere, its derivative, d?x/dt?, is zero everywhere. But dx/dt has jump discontinuities with a positive jump of 2/T at t= 
T/2, and a negative jump of 4/T at t = 0. Recall that the derivative of a signal at a jump discontinuity is an impulse at that point of 


strength equal to the amount of jump. Hence, d?x/dt2, the derivative of dx/dt, consists of a sequence of impulses, as depicted in Fig. 
7.27c; that is, 


dx 2 r T 
ex _< r\_» ((,-£ 49 
Bale!) mr 44(s—5)] 00 


From the time-differentiation property [Eq. (7.46)] 


d°*x . ‘ 
a <=> (jw)*X(@) = —@*X(@) (7.50a) 
Also, from the time-shifting property [Eq. (7.37b)] 
b(t —o) — > e (7.50b) 
Taking the Fourier transform of Eq. (7.49) and using the results in Eqs. (7.50), we obtain 


Pe 2 pe wis wr 8 .,fa@r 
-w X(@) = =[el —2+e/"*| = —{ cos — —1) = ——sin* | — 
t , Tt 2 t 4 


and 


It 


sinc? (=) (7.51) 
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The spectrum X(w) is depicted in Fig. 7.27d. This procedure of finding the Fourier transform can be applied to any function x(t) made 
up of straight-line segments with x(t) — 0 as |t| — oo. The second derivative of such a signal yields a sequence of impulses whose 
Fourier transform can be found by inspection. This example suggests a numerical method of finding the Fourier transform of an arbitrary 
signal x(t) by approximating the signal by straight-line segments. 


[T]Of the two differences, the former can be eliminated by change of variable from w to f (in hertz). In this case w = 2T fand dw = 2Tr 
df. 


Therefore, the direct and the inverse transforms are given by 
Oo 


xexfy= [ x(tje" 2" dt and x= f X(2nfje!*""' af 


wd 


This leaves only one significant difference, that of sign change in the exponential index. 


[tlWe are assuming a > 1, although the argument still holds if a < 1. In the latter case, compression becomes expansion by factor 1/a, 
and vice versa. 


[TlWhen a signal has infinite duration, we must consider its effective or equivalent duration. There is no unique definition of effective 
signal duration. One possible definition is given in Eq. (2.67). 


[2] Bracewell, R. N. Fourier Transform and Its Applications, rev. 2nd ed. McGraw-Hill, New York, 1986. 

[T]valid only if the transform of dx/dt exists. In other words, dx/dt must satisfy the Dirichlet conditions. The first Dirichlet condition implies 
[. 
We also require that x(t) — 0 as t — +o. Otherwise, x(t) has a dc component, which gets lost in differentiation, and there is no one-to- 
one relationship between x(t) and dx/dt. 


dx 


——- at < b 
dt = 


7.4 SIGNAL TRANSMISSION THROUGH LTIC SYSTEMS 
If x(t) and y(t) are the input and output of an LTIC system with impulse response h(t), then, as demonstrated in Eq. (7.44b) 


Y(w) = H(w)X() (7.52) 


This equation does not apply to (asymptotically) unstable systems because h(t) for such systems is not Fourier transformable. It applies 


to BIBO stable as well as most of the marginally stable systems.!T] Also the input x(t) itself must be Fourier transformable if we are to 
use Eq. (7.52). 


In Chapter 4, we saw that the Laplace transform is more versatile and capable of analyzing all kinds of LTIC systems whether stable, 
unstable, or marginally stable. Laplace transform can also handle exponentially growing inputs. In comparison to the Laplace transform, 
the Fourier transform in system analysis is not just clumsier, but also very restrictive. Hence, the Laplace transform is preferable to the 
Fourier transform in LTIC system analysis. We shall not belabor the application of the Fourier transform to LTIC system analysis. We 
consider just one example here. 


EXAMPLE 7.18 
Find the zero-state response of a stable LTIC system with frequency responsel#] 


| 
H(s) = —— 
(s) s+2 


and the input is x(t) = etu(t). 
In this case 


X(@) = —— 
(o) jo+l 


Moreover, because the system is stable, the frequency response H(jw) = H(w). Hence 


H(@) = H(S)\s=ja = Jo +2 


Therefore 


Y(w) = H(w)X(w) 
_ l 
~ (ja +2)(jw +1) 
Expanding the right-hand . in partial fractions yields 


¥(#) = ——— - ——~ 
~ Jort+ I j@+2 


and 


y(t) = (e' —e-” u(t) 


EXERCISE E7.11 


For the system in Example 7.18, show that the zero-input response to the input etu(—t) is y(t) = ¥fetu(—t) + e lu(t)] [Hint: Use pair 2 
t 


(Table 7.1) to find the Fourier transform of e u(—t).] 


HEURISTIC UNDERSTANDING OF LINEAR SYSTEM RESPONSE 

In finding the linear system response to arbitrary input, the time-domain method uses convolution integral and the frequency-domain 
method uses the Fourier integral. Despite the apparent dissimilarities of the two methods, their philosophies are amazingly similar. In 
the time-domain case we express the input x(t) as a sum of its impulse components; in the frequency-domain case, the input is 
expressed as a sum of everlasting exponentials (or sinusoids). In the former case, the response y(t) obtained by summing the system's 
responses to impulse components results in the convolution integral; in the latter case, the response obtained by summing the system's 
response to everlasting exponential components results in the Fourier integral. These ideas can be expressed mathematically as 
follows: 


1. For the time-domain case, 
5(t) ==> A(t) shows the impulse response 


of the system is A(r) 


= 
x(t) = / x(r)d(t — t)dt expresses X({) as assum 
= of impulse components 


and 


tS 
y(t) = / x(t)A(t —t)dr expresses y(f) as a sum of responses to 
= impulse components of the input x(t) 


2. For the frequency-domain case, 
ei ——» H(w)e! shows the system response 
to e/ is H(m)e!™ 
1 fe . 
x() = = X(w)e’“dw shows x(f) as a sum of everlasting 
2s exponential components 


a 


and 


|. T= . 
y= = / X(w)H (we! dw expresses y(f) is a sum of responses 
on I-00 to exponential components 
The frequency-domain view sees a system in terms of its frequency response (system response to various sinusoidal components). It 


views a signal as a sum of various sinusoidal components. Transmission of an input signal through a (linear) system is viewed as 
transmission of various sinusoidal components of the input through the system. 


It was not by coincidence that we use the impulse function in time-domain analysis and the exponential QlWt in studying the frequency 
domain. The two functions happen to be duals of each other. Thus, the Fourier transform of an impulse 8(t — T) is e JT and the 


Fourier transform of e/“o! is an impulse 2118(w — Wo). This time-frequency duality is a constant theme in the Fourier transform and 
linear systems. 


7.4-1 Signal Distortion During Transmission 


For a system with frequency response H(w), if X(w) and Y(u) are the spectra of the input and the output signals, respectively, then 


Y(w) = X(w)H(o) (7.53) 


The transmission of the input signal x(t) through the system changes it into the output signal y(t). Equation (7.53) shows the nature of 
this change or modification. Here X(Ww) and Y(w) are the spectra of the input and the output, respectively. Therefore, H(uw) is the 
spectral response of the system. The output spectrum is obtained by the input spectrum multiplied by the spectral response of the 
system. Equation (7.53), which clearly brings out the spectral shaping (or modification) of the signal by the system, can be expressed in 
polar form as 


I¥ (weit? - \X(w)||H(@)|eileX +4001 


Therefore 
|[Y(w)| = |X(@)| |H(@)| (7.54a) 
LY(w) = £X(@) + LH(@) (7.54b) 


During the transmission, the input signal amplitude spectrum |X(w)| is changed to |X(w)| |H(w)|. Similarly, the input signal phase 
spectrum 2X(w) is changed to 2X(w) + ZH(w). An input signal spectral component of frequency w is modified in amplitude by a 
factor |H(w)| and is shifted in phase by an angle 2H(w). Clearly, |H(u))| is the amplitude response, and 2H(w) is the phase response 
of the system. The plots of |H(w)| and ZH(w) as functions of w show at a glance how the system modifies the amplitudes and phases 


of various sinusoidal inputs. This is the reason why H(w) is also called the frequency response of the system. During transmission 
through the system, some frequency components may be boosted in amplitude, while others may be attenuated. The relative phases of 
the various components also change. In general, the output waveform will be different from the input waveform. 


DISTORTIONLESS TRANSMISSION 

In several applications, such as signal amplification or message signal transmission over a communication channel, we require that the 
output waveform be a replica of the input waveform. In such cases we need to minimize the distortion caused by the amplifier or the 
communication channel. It is, therefore, of practical interest to determine the characteristics of a system that allows a signal to pass 
without distortion (distortionless transmission). 


Transmission is said to be distortionless if the input and the output have identical wave-shapes within a multiplicative constant. A 
delayed output that retains the input waveform is also considered to be distortionless. Thus, in distortionless transmission, the input x(t) 
and the output y(t) satisfy the condition 


y(t) = Gox(t — ty) (7.55) 


The Fourier transform of this equation yields 


¥(w) = GoX (we 


But 
Y(w) = X(w)H(@) 


Therefore 


H(w) = Goe i 

This is the frequency response required of a system for distortionless transmission. From this equation it follows that 
|H(w@)| = Go (7.56a) 
LH(@) = —ol, (7.56b) 


This result shows that for distortionless transmission, the amplitude response |H(w)| must be a constant, and the phase response 
ZH(u) must be a linear function of w with slope —ty, where fg is the delay of the output with respect to input (Fig. 7.28). 


Go| |H@)| 


r Pee, o> 


£H(@) 


Figure 7.28: LTIC system frequency response for distortionless transmission. 
MEASURE OF TIME DELAY VARIATION WITH FREQUENCY 


The gain |H(w)| = Gg means that every spectral component is multiplied by a constant Go. Also as seen in connection with Fig. 7.22, a 
linear phase 2H(w) = —wtg means that every spectral component is delayed by fy seconds. This results in the output equal to Go 
times the input delayed by ty seconds. Because each spectral component is attenuated by the same factor (Go) and delayed by exactly 
the same amount (ty), the output signal is an exact replica of the input (except for attenuating factor Gg and delay fy). 


For distortionless transmission, we require a linear phase characteristic. The phase is not only linear function of w, but it should also 
pass through the origin w = 0. In practice, many systems have a phase characteristic that may be only approximately linear. A 
convenient way of judging phase linearity is to plot the slope of 7H(w) as a function of frequency. This slope, which is constant for an 
ideal linear phase (ILP) system, is a function of w in the general case and can be expressed as 


a 
Oo) = ——L ‘t 25 
t.(@) a5 H(@) (7.57) 


If tg(w) is constant, all the components are delayed by the same time interval tg. But if the slope is not constant, the time delay tg 
varies with frequency. This variation means that different frequency components undergo different amounts of time delay, and 
consequently the output waveform will not be a replica of the input waveform. As we shall see, tg(w) plays an important role in 
bandpass systems and is called the group delay or envelope delay. Observe that constant tg [Eq. (7.56b)] implies constant tg. Note that 


ZH(w) = do- Wtg also has a constant ty. Thus, constant group delay is a more relaxed condition. 


It is often thought (erroneously) that flatness of amplitude response |H(w)| alone can guarantee signal quality. However, a system that 
has a flat amplitude response may yet distort a signal beyond recognition if the phase response is not linear (ty not constant). 


THE NATURE OF DISTORTION IN AUDIO AND VIDEO SIGNALS 

Generally speaking, the human ear can readily perceive amplitude distortion but is relatively insensitive to phase distortion. For the 
phase distortion to become noticeable, the variation in delay [variation in the slope of 7H(w)] should be comparable to the signal 
duration (or the physically perceptible duration, in case the signal itself is long). In the case of audio signals, each spoken syllable can 
be considered to be an individual signal. The average duration of a spoken syllable is of a magnitude of the order of 0.01 to 0.1 second. 
The audio systems may have nonlinear phases, yet no noticeable signal distortion results because in practical audio systems, maximum 
variation in the slope of 2H(w) is only a small fraction of a millisecond. This is the real truth underlying the statement that "the human 


ear is relatively insensitive to phase distortion.[3]" As a result, the manufacturers of audio equipment make available only |H(w)|, the 
amplitude response characteristic of their systems. 


For video signals, in contrast, the situation is exactly the opposite. The human eye is sensitive to phase distortion but is relatively 
incensitive to amplitude distortion. The amplitude distortion in television signals manifests itself as a partial destruction of the relative 
half-tone values of the resulting picture, but this effect is not readily apparent to the human eye. The phase distortion (nonlinear phase), 
on the other hand, causes different time delays in different picture elements. The result is a smeared picture, and this effect is readily 
perceived by the human eye. Phase distortion is also very important in digital communication systems because the nonlinear phase 
characteristic of a channel causes pulse dispersion (spreading out), which in turn causes pulses to interfere with neighboring pulses. 
Such interference between pulses can cause an error in the pulse amplitude at the receiver: a binary 1 may read as 0, and vice versa. 


7.4-2 Bandpass Systems and Group Delay 


The distortionless transmission conditions [Eqs. (7.56)] can be relaxed slightly for bandpass systems. For lowpass systems, the phase 
characteristics not only should be linear over the band of interest but should also pass through the origin. For bandpass systems, the 
phase characteristics must be linear over the band of interest but need not pass through the origin. 


Consider an LT| system with amplitude and phase characteristics as shown in Fig. 7.29, where the amplitude spectrum is a constant 
Go and the phase is dg — Wty over a band 2W centered at frequency We. Over this band, we can describe H(w) asiT] 


H(w) = Goel ®"”— wm > 0 (7.58) 
|H(w)| 
~ a 21 
db 
@, bot MO, o> 
~ Hw) 
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Figure 7.29: Generalized linear phase characteristics. 


The phase of H(uw) in Eq. (7.58), shown dotted in Fig. 7.29b, is linear but does not pass through the origin. 


Consider a modulated input signal z(t) = x(t) cos Wet. This is a bandpass signal, whose spectrum is centered at w = We. The signal 


cos Wet is the carrier, and the signal x(t), which is a lowpass signal of bandwidth W (see Fig. 7.25), is the envelope of z(t).{4] We shall 


now show that the transmission of z(t) through H(w) results in distortionless transmission of the envelope x(t). However, the carrier 


phase changes by $9. To show this, consider an input Z(t) = x(t)e/" and the corresponding output §(2), From Eq. (7.39), 


(7.39), Z(w) = X(@—@, (wv) = X(w — We), and the corresponding output spectrum (a) is given by 
Y(w) = H(w)Z(w) = H(w)X(w —a,) 


Recall that the bandwidth of X(w) is W, so that the bandwidth of X(w — Ww ) is 2W, centered at We. Over this range H(w) is given by 
Eq. (7.58). Hence, 
¥(w) = GoX (w — we! ®-) = Goe’® X (w — we" 


Use of Eqs. (7.37a) and (7.39) yields ¥(4) as _ 
9) = Goel x(t t,o") = Goxlt — 1,)elO¥4 


joel 


This is the system response to input Z(t) = x(Ne , which is a complex signal. We are really interested in finding the response to 


the input z(t) = x(t) cos Wet, which is the real part of 2(f) = x(1)e?" Hence, we use property (2.40) to obtain y(¢), the system 
response to the input z(t) = x(t) cos Wel, as 


y(t) = Gox(t — t,) cos [w(t — t,) + bo)] (7.59) 


where tg, the group (or envelope) delay, is the negative slope of 27H(w) at We.l8] The output y(t) is basically the delayed input z(t — 
tg), except that the output carrier acquires an extra phase op. The output envelope x(t — ty) is the delayed version of the input 
envelope x(t) and is not affected by extra phase go of the carrier. In a modulated signal, such as, x(t) cos Wet, the information 
generally resides in the envelope x(t). Hence, the transmission is considered to be distortionless if the envelope x(t) remains 
undistorted. 


Most of the practical systems satisfy conditions (7.58), at least over a very small band. Figure 7.29b shows a typical case in which this 
condition is satisfied for a small band W centered at frequency We. 


A system in Eq. (7.58) is said to have a generalized linear phase (GLP), as illustrated in Fig. 7.29. The ideal linear phase (ILP) 
characteristics is shown in Fig. 7.28. For distortionless transmission of bandpass signals, the system need satisfy Eq. (7.58) only over 
the bandwidth of the bandpass signal. 


Caution Recall that the phase response associated with the amplitude response may have jump discontinuities when the 
amplitude response goes negative. Jump discontinuities also arise because of the use of the principal value for phase. 
Under such conditions, to compute the group delay [Eq. (7.57)], we should ignore the jump discontinuities. 


EXAMPLE 7.19 


a. A signal z(t), shown in Fig. 7.30b, is given by 
Z(t) = X(f) COS Wel 


Figure 7.30 


where W, = 2000Tt. The pulse x(t) (Fig. 7.30a) is a lowpass pulse of duration 0.1 second and has a bandwidth of about 
10 Hz. This signal is passed through a filter whose frequency response is shown in Fig. 7.30c (shown only for positive w). 
Find and sketch the filter output y(t). 


b. Find the filter response if w. = 4000Tr. 


a. The spectrum Z(w) is a narrow band of width 20 Hz, centered at frequency fp = 1 kHz. The gain at the center frequency 
(1 kHz) is 2. The group delay, which is the negative of the slope of the phase plot, can be found by drawing tangents at 
We, as shown in Fig. 7.30c. The negative of the slope of the tangent represents fy, and the intercept along the vertical 
axis by the tangent represents 9 at that frequency. From the tangents at we., we find tg, the group delay, as 

4 es 
fies 2.4n — 0.47 = 10-3 
2000s 
The vertical axis intercept is @9 = —0.41r. Hence, by using Eq. (7.59) with gain Gg = 2, we obtain 
y(t) = 2x(t —t,) cos[o,.(t—1,)-—0.47] @,=20007 1t,=107% 
Figure 7.30d shows the output y(t), which consists of the modulated pulse envelope x(t) delayed by 1 ms and the phase 


of the carrier changed by —0.4Tt. The output shows no distortion of the envelope x(t), only the delay. The carrier phase 
change does not affect the shape of envelope. Hence, the transmission is considered distortionless. 


b. Figure 7.30c shows that when we, = 4000Tr, the slope of 2H(w) is zero, so that fg = 0. Also the gain Gg = 1.5, and the 
intercept of the tangent with the vertical axis is dg = —3.11. Hence 
y(t) = 1L.5x(t) cos (w,t — 3.177) 


This too is a distortionless transmission for the same reasons as for case (a). 
[tlFor marginally stable systems, if the input x(t) contains a finite amplitude sinusoid of the system's natural frequency, which leads to 
resonance, the output is not Fourier transformable. It does, however, apply to marginally stable systems if the input does not contain a 


finite amplitude sinusoid of the system's natural frequency. 


[t]Stability implies that the region of convergence of H(s) includes the jw axis. 


[3]Guillemin, E. A. Theory of Linear Physical Systems. Wiley, New York, 1963. 


[tlBecause the phase function is an odd function of w, if 2H(w) = Wo — Wty for w = 0, over the band 2W (centered at we), then 
ZH(w) = —o — Wty for w < 0 over the band 2W (centered at — we), as shown in Fig. 7.29a. 


[*]The envelope of a bandpass signal is well defined only when the bandwidth of the envelope is well below the carrier W. (W < We). 


[$]Equation (7.59) can also be expressed as 
y(t) = Gox(t — fg) cos @{f — tpn) 


where fpp, called the phase delay at We, is given by tpp(We) = (Wetg — 0)/W,. Generally, toh varies with w, and we can write 


wl, — dig 
tpn(@) = pace SA 


“# 


Recall also that tg itself may vary with w. 


7.5 IDEAL AND PRACTICAL FILTERS 


Ideal filters allow distortionless transmission of a certain band of frequencies and completely suppress the remaining frequencies. The 
ideal lowpass filter (Fig. 7.31), for example, allows all components below w = W rad/s to pass without distortion and suppresses all 
components above w = W. Figure 7.32 illustrates ideal highpass and bandpass filter characteristics. 


ia b 


Figure 7.31: Ideal lowpass filter: (a) frequency response and (b) impulse response. 
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Figure 7.32: Ideal (a) highpass and (b) bandpass filter frequency responses. 


The ideal lowpass filter in Fig. 7.31a has a linear phase of slope —tg, which results in a time delay of ty seconds for all its input 
components of the frequencies below W rad/s. Therefore, if the input is a signal x(t) bandlimited to W rad/s, the output y(t) is x(t) 
delayed by ty: that is, 

y(t) = x(t — ta) 

The signal x(t) is transmitted by this system without distortion, but with time delay ty. For this filter |H(w)| = rect (w/2W) and ZH(w) = 


e J¥td so that 


” | e-jot 
H(q@) = rect (=) e (7.60a) 


The unit impulse response h(t) of this filter is obtained from pair 18 (Table 7.1) and the time-shifting property 


l @ 
I — F—' |rec Jota 
(ft) = F rect (52 Je 


W 
= — sinc [W(t — t,)] (7.60b) 
bia 


Recall that h(t) is the system response to impulse input 8(t), which is applied at t = 0. Figure 7.31b shows a curious fact: the response 
h(t) begins even before the input is applied (at t = 0). Clearly, the filter is noncausal and therefore physically unrealizable. Similarly, one 
can show that other ideal filters (such as the ideal highpass or ideal bandpass filters depicted in Fig. 7.32) are also physically 
unrealizable. 


For a physically realizable system, h(t) must be causal: that is, 

h(t) =0 for{ < 0 

In the frequency domain, this condition is equivalent to the well-known Paley-Wiener criterion, which states that the necessary and 
sufficient condition for the amplitude response |H(w)| to be realizable ist] 


© |In| (a 
cle aon 
_~ l+a@* 


If H(w) does not satisfy this condition, it is unrealizable. Note that if |H(w)| = 0 over any finite band, | In |H(w)ll = co over that band, 
and condition (7.61) is violated. If, however, H(w) = 0 ata single frequency (or a set of discrete frequencies), the integral in Eq. (7.61) 
may still be finite even though the integrand is infinite at those discrete frequencies. Therefore, for a physically realizable system, H(w) 
may be zero at some discrete frequencies. Therefore, for a physically realizable system, H(w) may be zero at some discrete 
frequencies, but it cannot be zero over any finite band. In addition, if |H(w)| decays exponentially (or at a higher rate) with uw, the 
integral in (7.61) goes to infinity, and |H(u)| cannot be realized. Clearly, |H(w)| cannot decay too fast with uw. According to this 
criterion, ideal filter characteristics (Figs. 7.31 and 7.32) are unrealizable. 


The impulse response /A(f) in Fig. 7.31 is not realizable. One practical approach to filter design is to cut off the tail of h(t) for t< 0. The 


resulting causal impulse response Att ), given by 


h(t) = h(t)ut) 


is physically realizable because it is causal (Fig. 7.33). If tg is sufficiently large, h(t) will be a close approximation of h(t), and the 


resulting filter H(@) will be a good approximation of an ideal filter. This close realization of the ideal filter is achieved because of the 
increased value of time delay ty. This observation means that the price of close realization is higher delay in the output; this situation is 
common in noncausal systems. Of course, theoretically, a delay ty = o is needed to realize the ideal characteristics. But a glance at 

x zs 
Fig. 7.31b shows that a delay fg of three or four times W will make h(t) a reasonable close version of h(t — tq). For instance, an audio 


filter is required to handle frequencies of up to 20 kHz (W = 40,000Tr). In this case, a tg of about 10-4 (0.1 ms) would be a reasonable 
choice. The truncation operation [cutting the tail of h(t) to make it causal], however, creates some unsuspected problems. We discuss 
these problems and their cure in Section 7.8. 
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Figure 7.33: Approximate realization of an ideal low-pass filter by truncation of its impulse response. 


In practice, we can realize a variety of filter characteristics that approach the ideal. Practical (realizable) filter characteristics are gradual, 
without jump discontinuities in amplitude response. 


EXERCISE E7.12 


Show that a filter with Gaussian frequency response H(w) = e WW ig unrealizable. Demonstrate this fact in two ways: first by showing 
that its impulse response is noncausal, and then by showing that |H(w)| violates the Paley-Wiener criterion. [Hint: Use pair 22 in Table 
7.1.) 


THINKING IN THE TIME AND FREQUENCY DOMAINS: A TWO-DIMENSIONAL VIEW OF SIGNALS AND SYSTEMS 
Both signals and systems have dual personalities, the time domain and the frequency domain. For a deeper perspective, we should 
examine and understand both these identities because they offer complementary insights. An exponential signal, for instance, can be 


specified by its time-domain description such as e~2'u(t) or by its Fourier transform (its frequency-domain description) 1/(jw + 2). The 
time-domain description depicts the waveform of a signal. The frequency-domain description portrays its spectral composition (relative 


amplitudes of its sinusoidal (or exponential) components and their phases). For the signal e 2! for instance, the time-domain description 
portrays the exponentially decaying signal with a time constant 0.5. The frequency-domain description characterizes it as a lowpass 
signal, which can be synthesized by sinusoids with amplitudes decaying with frequency roughly as 1/w. 


An LTIC system can also be described or specified in the time domain by its impulse response h(f) or in the frequency domain by its 
frequency response H(w). In Section 2.7, we studied intuitive insights in the system behavior offered by the impulse response, which 
consists of characteristic modes of the system. By purely qualitative reasoning, we saw that the system responds well to signals that are 
similar to the characteristic modes and responds poorly to signals that are very different from those modes. We also saw that the shape 
of the impulse response h(t) determines the system time constant (speed of response), and pulse dispersion (spreading), which, in turn, 
determines the rate of pulse transmission. 


The frequency response H(w) specifies the system response to exponential or sinusoidal input of various frequencies. This is precisely 
the filtering characteristic of the system. 


Experienced electrical engineers instinctively think in both domains (the time and frequency) whenever possible. When they look at a 
signal, they consider, its waveform, the signal width (duration), and the rate at which the waveform decays. This is basically a time- 
domain perspective. They also think of the signal in terms of its frequency spectrum, that is, in terms of its sinusoidal components and 
their relative amplitudes and phases, whether the spectrum is lowpass, bandpass, highpass and so on. This is the frequency-domain 
perspective. When they think of a system, they think of its impulse response h(t). The width of h(t) indicates the time constant 
(response time): that is, how fast the system is capable of responding to an input, and how much dispersion (spreading) it will cause. 
This is the time-domain perspective. From the frequency-domain perspective, these engineers view a system as a filter, which 
selectively transmits certain frequency components and suppresses the others [frequency response H(w)]. Knowing the input signal 
spectrum and the frequency response of the system, they create a mental image of the output signal spectrum. This concept is 
precisely expressed by Y(w) = X(w)H(w). 


We can analyze LTI systems by time-domain techniques or by frequency-domain techniques. Then why learn both? The reason is that 
the two domains offer complementary insights into system behavior. Some aspects are easily grasped in one domain; other aspects 
may be easier to see in the other domain. Both the time-domain and frequency-domain methods are as essential for the study of 
signals and systems as two eyes are essential to a human being for correct visual perception of reality. A person can see with either 
eye, but for proper perception of three-dimensional reality, both eyes are essential. 


It is important to keep the two domains separate, and not to mix the entities in the two domains. If we are using the frequency domain 
to determine the system response, we must deal with all signals in terms of their spectra (Fourier transforms) and all systems in terms 
of their frequency responses. For example, to determine the system response y(t) to an input x(t), we must first convert the input signal 
into its frequency-domain description X(w). The system description also must be in the frequency domain, that is, the frequency 
response H(w). The output signal spectrum Y(w) = X(w)H(w). Thus, the result (output) is also in the frequency domain. To determine 
the final answer y(t), we must take the inverse transform of Y(w). 


[tlWe are assuming that |H(w)| is square integrable, that is, 


Oo 
/ |H(«)|* dw < 


= 


Note that the Paley-Wiener criterion is a criterion for the realizability of the amplitude response |H(w)|. 


7.6 SIGNAL ENERGY 


The signal energy E, of a signal x(t) was defined in Chapter 1 as 


OD 
E, = / |x(t)|? dt (7.62) 


no 
Signal energy can be related to the signal spectrum X(w) by substituting Eq. (7.8b) in Eq. (7.62): 
~ x r l x 
E -/ x(x" (1) dt - | x(t) |— X'(w)e 2“ do at 
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Here we used the fact that x*(f), being the conjugate of x(t), can be expressed as the conjugate of the right-hand side of Eq. (7.8b). 
Now, interchanging the order of integration yields 


1 OO ~ - 
E, / X*(@) / x(ne ay da 
7x BA pe = 


1 ~ 
_-— X(w)X"*(w) dw 


27 Jn 
l = , 
= al |X(w)|* dw (7.63) 
2% J cx 
Consequently, 
2 5) l 2 4 
E, -/ Ix(t)|* dt = = / |X (w)|" dw (7.64) 


This is the statement of the well-known Parseval's theorem (for the Fourier transform). A similar result was obtained in Eqs. (6.40) and 
(6.41) for a periodic signal and its Fourier series. This result allows us to determine the signal energy from either the time-domain 
specification x(t) or the corresponding frequency-domain specification X(w). 


Equation (7.63) can be interpreted to mean that the energy of a signal x(t) results from energies contributed by all the spectral 
components of the signal x(t). The total signal energy is the area under [X(w)?| (divided by 21r). If we consider a small band Aw(Aw 
— 0), as illustrated in Fig. 7.34, the energy AE, of the spectral components in this band is the area of [X(w)|? under this band divided 
by 211): 


I ‘ : A 
AE, = —|X(@)|? Aw =|X(@)P? Af = =Af Hz (7.65) 
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Figure 7.34: Interpretation of energy spectral density of a signal. 


Therefore, the energy contributed by the components in this band of Af (in hertz) is [X(w)|2 AF. The total signal energy is the sum of 


energies of all such bands and is indicated by the area under [X(w)|? as in Eq. (7.63). Therefore, [X(w)|? is the energy spectral density 
(per unit bandwidth in hertz). 


For real signals, X(w) and X(—w) are conjugates, and [X(w)|? is an even function of w because 


|X (w)|? = X(w)X*(w) = X(w)X(—o) 
Therefore, Eq. (7.63) can be expressed aslT] 
l oo 5 
B= - | |\X(w)|" dw (7.66) 


The signal energy E,, which results from contributions from all the frequency components from w = 0 to », is given by (1 / Tr times) 


the area under |X(w)|2 from w = 0 to o. It follows that the energy contributed by spectral components of frequencies between w , and 
Wo is 


1 ¢@ . 
AE, = - | |X(@)\* dw (7.67) 
EXAMPLE 7.20 


Find the energy of signal x(t) = e y(t). Determine the frequency W (rad/s) so that the energy contributed by the spectral components 
of all the frequencies below W is 95% of the signal energy E,. 


We have 


~ z x : ] 
Ex =-/[ x*(t)dt =| ee“ dt= = (7.68) 


sw 


We can verify this result by Parseval's theorem. For this signal 


X(@) = ——— 
jJo+a 


and 
l ~ 2 l x 1 1 

E,= = [ |X(w)|* dw = = | ——- dw = ——- tan~! @ 
mt Jo rJo of +a’ a a 
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The band w = 0 to w = W contains 95% of the signal energy, that is, 0.95/2a. Therefore, from Eq. (7.67) with wy = 0 and Wo = W, we 
obtain 


0.95 1 7" dw 1 ,o|" 1 /W 
—=-—- f/f —S=— tan! —| =—tan' — 
2a aJo @+a? 7a a\, 7a a 
or 
0.95: W 
—— =tan'— =<» W=12.706a rad/s (7.69) 


2 a 


This result indicates that the spectral components of x(t) in the band from 0 (dc) to 12.706a rad/s (2.02a Hz) contribute 95% of the total 
signal energy; all the remaining spectral components (in the band from 12.706a rad/s to o) contribute only 5% of the signal energy. 


EXERCISE E7.13 


Use Parseval's theorem to show that the energy of the signal x(t) = 2a/(t? + a%) is 21/a. [Hint: Find X(w) using pair 3 of Table 7.1 and 
the duality property.] 


THE ESSENTIAL BANDWIDTH OF A SIGNAL 

The spectra of all practical signals extend to infinity. However, because the energy of any practical signal is finite, the signal spectrum 
must approach 0 as w — o. Most of the signal energy is contained within a certain band of B Hz, and the energy contributed by the 
components beyond B Hz is negligible. We can therefore suppress the signal spectrum beyond B Hz with little effect on the signal 
shape and energy. The bandwidth B is called the essential bandwidth of the signal. The criterion for selecting B depends on the error 
tolerance in a particular application. We may, for example, select B to be that band which contains 95% of the signal energy.!T] This 
figure may be higher or lower than 95%, depending on the precision needed. Using such a criterion, we can determine the essential 
bandwidth of a signal. The essential bandwidth B for the signal e~@‘u(t), using 95% energy criterion, was determined in Example 7.20 
to be 2.02a Hz. 


Suppression of all the spectral components of x(f) beyond the essential bandwidth results in a signal X(t \(t), which is a close 
approximation of x(t). If we use the 95% criterion for the essential bandwidth, the energy of the error (the difference) 
x(t) — E(t) is 5%) is 5% of Ey. 


[Tin Eq. (7.66) it is assumed that X(w) does not contain an impulse at w = 0. If such an impulse exists, it should be integrated 
separately with a multiplying factor of 1/2Tt rather than 1/Tr. 


[tlFor lowpass signals, the essential bandwidth may also be defined as a frequency at which the value of the amplitude spectrum is a 
small fraction (about 1%) of its peak value. In Example 7.20, for instance, the peak value, which occurs at w = 0, is 1/a. 


7.7 APPLICATION TO COMMUNICATIONS: AMPLITUDE MODULATION 


Modulation causes a spectral shift in a signal and is used to gain certain advantages mentioned in our discussion of the frequency- 
shifting property. Broadly speaking, there are two classes of modulation: amplitude (linear) modulation and angle (nonlinear) modulation. 
In this section, we shall discuss some practical forms of amplitude modulation. 


7.7-1 Double-Sideband, Suppressed-Carrier (DSB-SC) Modulation 


In amplitude modulation, the amplitude A of the carrier A cos (Wet + 8.) is varied in some manner with the baseband (message)!#] 
signal m(t) (known as the modulating signal). The frequency w, and the phase 9, are constant. We can assume 6, = 0 without loss of 
generality. If the carrier amplitude A is made directly proportional to the modulating signal m(t), the modulated signal is m(t) cos Wet 
(Fig. 7.35). As was indicated earlier [Eq. (7.41)], this type of modulation simply shifts the spectrum of m(f) to the carrier frequency (Fig. 
7.35c). Thus, if 

m(t) <> M(@) 


then 


m(L) COS @,t —> 1[M(@ + w.) + M(@ — @,)| (7.70) 


Figure 7.35: DSB-SC modulation. 


Recall that M(w — Ww ,) is M(u)-shifted to the right by w, and M(w + W,) is M(w)-shifted to the left by w.. Thus, the process of 
modulation shifts the spectrum of the modulating signal to the left and the right by we. Note also that if the bandwidth of m(t) is B Hz, 
then, as indicated in Fig. 7.35c, the bandwidth of the modulated signal is 2B Hz. We also observe that the modulated signal spectrum 
centered at WwW, is composed of two parts: a portion that lies above W., known as the upper sideband (USB), and a portion that lies 
below We, known as the lower sideband (LSB). Similarly, the spectrum centered at —w, has upper and lower sidebands. This form of 
modulation is called double sideband (DSB) modulation for obvious reason. 


The relationship of B to Wg is of interest. Figure 7.35c shows that W, = 27TB to avoid the overlap of the spectra centered at t¢. If We_ < 
2Tt B, the spectra overlap and the information of m(f) is lost in the process of modulation, a loss that makes it impossible to get back 
m(t) from the modulated signal m(t) cos Wet.[T] 


EXAMPLE 7.21 
For a baseband signal m(t) = cos Wyyt, find the DSB signal, and sketch its spectrum. Identify the upper and lower sidebands. 


We shall work this problem in the frequency domain as well as the time domain to clarify the basic concepts of DSB-SC modulation. In 
the frequency-domain approach, we work with the signal spectra. The spectrum of the baseband signal m(t) = cos Wyyt is given by 


M (w) = 1[8(@ — @m) + 8(@ + @m)] 

The spectrum consists of two impulses located at tw, as depicted in Fig. 7.36a. The DSB-SC (modulated) spectrum, as indicated by 
Eq. (7.70), is the baseband spectrum in Fig. 7.36a shifted to the right and the left by w, (times 0.5), as depicted in Fig. 7.36b. This 
spectrum consists of impulses at +(W>. — Wr) and +(W,. + Wr). The spectrum beyond w, is the upper sideband (USB), and the one 
below w, is the lower sideband (LSB). Observe that the DSB-SC spectrum does not have as a component the carrier frequency We. 
This is why the term double-sideband, suppressed carrier (DSB-SC) is used for this type of modulation. 


DSB spectrum 
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Figure 7.36: An example of DSB-SC modulation. 


In the time-domain approach, we work directly with signals in the time domain. For the baseband signal m(t) = cos Wt, the DSB-SC 
signal @psp-sc(t) is 


Posp-sc = mit) cos @,1 


= COS @»,f COS @,1 
= $[COS (Me + Mm)t + COS (@- — Om )t] (7.71) 


This result shows that when the baseband (message) signal is a single sinusoid of frequency Ww,,, the modulated signal consists of two 
sinusoids: the component of frequency WwW. + W,, (the upper sideband), and the component of frequency W, — Wr, (the lower 
sideband). Figure 7.36b illustrates precisely the spectrum of dpsp-sc(t). Thus, each component of frequency w,, in the modulating 
signal results into two components of frequencies We + Wry and We — Wy in the modulated signal. This being a DSB-SC (suppressed 


carrier) modulation, there is no component of the carrier frequency Ww, on the right-hand side of Eq. (7.71).(11] 


DEMODULATION OF DSB-SC SIGNALS 

The DSB-SC modulation translates or shifts the frequency spectrum to the left and the right by w, (i.e., at + We and —W,), as seen 
from Eq. (7.70). To recover the original signal m(t) from the modulated signal, we must retranslate the spectrum to its original position. 
The process of recovering the signal from the modulated signal (retranslating the spectrum to its original position) is referred to as 
demodulation, or detection. Observe that if the modulated signal spectrum in Fig. 7.35c is shifted to the left and to the right by Ww, (and 


halved), we obtain the spectrum illustrated in Fig. 7.37b, which contains the desired baseband spectrum in addition to an unwanted 
spectrum at +2W,. The latter can be suppressed by a lowpass filter. Thus, demodulation, which is almost identical to modulation, 
consists of multiplication of the incoming modulated signal m(t) cos wet by a carrier cos Wf followed by a lowpass filter, as depicted in 
Fig. 7.37a. We can verify this conclusion directly in the time domain by observing that the signal e(t) in Fig. 7.37a is 


e(t) = m(t) cos* wet 


—T 52 
sln(t) + m(t) cos 2@t] (7.72a) 
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Figure 7.37: Demodulation of DSB-SC: (a) demodulator and (b) spectrum of e(f). 


Therefore, the Fourier transform of the signal e(f) is 
E(@)= 1M (w) + 11M (w + 20.) + M(m@ — 2m,)] (7.72b) 


Hence, e(t) consists of two components (1/2)m(t) and (1/2)m(t) cos 2wet, with their spectra, as illustrated in Fig. 7.37b. The spectrum 
of the second component, being a modulated signal with carrier frequency 2W,¢, is centered at +2W,. Hence, this component is 
suppressed by the lowpass filter in Fig. 7.37a. The desired component (1/2)M(w), being a lowpass spectrum (centered at w = 0), 
passes through the filter unharmed, resulting in the output (1/2)m(tf). 


A possible form of lowpass filter characteristics is depicted (dotted) in Fig. 7.37b. In this method of recovering the baseband signal, 
called synchronous detection, or coherent detection, we use a carrier of exactly the same frequency (and phase) as the carrier used for 
modulation. Thus, for demodulation, we need to generate a local carrier at the receiver in frequency and phase coherence 
(synchronism) with the carrier used at the modulator. We shall demonstrate in Example 7.22 that both phase and frequency 
synchronism are extremely critical. 


EXAMPLE 7.22 


Discuss the effect of lack of frequency and phase coherence (synchronism) between the carriers at the modulator (transmitter) and the 
demodulator (receiver) in DSB-SC. 


Let the modulator carrier be cos Wet (Fig. 7.35a). For the demodulator in Fig. 7.37a, we shall consider two cases: with carrier cos (Wt 
+ 8) (phase error of 8) and with carrier cos (Ww. + Aw)t (frequency error Aw). 


a. With the demodulator carrier cos (Wt + 8) (instead of cos wef) in Fig. 7.37a, the multiplier output is e(t) = m(t) cos Wet 


cos (Wet + 8) instead of m(t) cos? Wt. From the trigonometric identity, we obtain 


e(t) = m(t) cos w,t Cos (@,f + 0) 


= im( t)[cos 0 + cos (2@,t + 0)] 


The spectrum of the component (1/2)m(t) cos (2W,t + 8) is centered at + 2W,. Consequently, it will be filtered out by the 
lowpass filter at the output. The component (1/2)m(t) cos 9 is the signal m(t) multiplied by a constant (1/2) cos 8. The 
spectrum of this component is centered at w = 0 (lowpass spectrum) and will pass through the lowpass filter at the output, 
yielding the output (1/2)m(t) cos 8. 


If 8 is constant, the phase asynchronism merely yields an output that is attenuated (by a factor cos 8). Unfortunately, in 
practice, 8 is often the phase difference between the carriers generated by two distant generators and varies randomly 
with time. This variation would result in an output whose gain varies randomly with time. 


b. In the case of frequency error, the demodulator carrier is cos (Ww, + Aw)t. This situation is very similar to the phase error 
case in part (a) with 6 replaced by (Aw)t. Following the analysis in part (a), we can express the demodulator product e(f) 
as 
e(t) = m(t) cos w,t cos (@,. + Aw)t 


im(t)[cos (Am)t + cos (2, + Aw)t] 


The spectrum of the component (1/2)m(t) cos (2w + Aw)t is centered at +(2w, + Aw). Consequently, this component will 
be filtered out by the lowpass filter at the output. The component (1/2)m(t) cos (Aw)t is the signal m(t) multiplied by a 
low-frequency carrier of frequency Aw. The spectrum of this component is centered at t+Aw. In practice, the frequency 
error (Aw) is usually very small. Hence, the signal (1/2)m(t) cos (Aw)t (whose spectrum is centered at Aw) is a 
lowpass signal and passes through the lowpass filter at the output, resulting in the output (1/2)m(t) cos (Aw)t. The output 
is the desired signal m(t) multiplied by a very-low-frequency sinusoid cos (Aw)tf. The output in this case is not merely an 
attenuated replica of the desired signal m(t), but represents m(t) multiplied by a time-varying gain cos (Aw)t. If, for 
instance, the transmitter and the receiver carrier frequencies differ just by 1 Hz, the output will be the desired signal m(t) 
multiplied by a time-varying signal whose gain goes from the maximum to 0 every half-second. This is like a restless child 
fidding with the volume control knob of a receiver, going from maximum volume to zero volume every half-second. This 
kind of distortion (called the beat effect) is beyond repair. 


7.7-2 Amplitude Modulation (AM) 


For the suppressed-carrier scheme just discussed, a receiver must generate a carrier in frequency and phase synchronism with the 
carrier at a transmitter that may be located hundreds or thousands of miles away. This situation calls for a sophisticated receiver, which 
could be quite costly. The other alternative is for the transmitter to transmit a carrier A cos wt [along with the modulated signal m(t) 
COS W lf] so that there is no need to generate a carrier at the receiver. In this case the transmitter needs to transmit much larger power, 
a rather expensive procedure. In point-to-point communications, where there is one transmitter for each receiver, substantial complexity 
in the receiver system can be justified, provided there is a large enough saving in expensive high-power transmitting equipment. On the 
other hand, for a broadcast system with a multitude of receivers for each transmitter, it is more economical to have one expensive high- 
power transmitter and simpler, less expensive receivers. The second option (transmitting a carrier along with the modulated signal) is 
the obvious choice in this case. This is amplitude modulation (AM), in which the transmitted signal  aj(t) is given by 


Pay (tl) = ACOs @,t + m(f) COs @,t (7.73a) 


=[A+m(t)]cos@-.t (7.73b) 


Recall that the DSB-SC signal is m(t) cos wet. From Eq. (7.73b) it follows that the AM signal is identical to the DSB-SC signal with A + 
m(t) as the modulating signal [instead of m(t)]. Therefore, to sketch apy(t), we sketch A +m(t) and —[A + m(t)] as the envelopes and 
fill in between with the sinusoid of the carrier frequency. Two cases are considered in Fig. 7.38. In the first case, A is large enough so 
that A + m(t) = 0 (is nonnegative) for all values of f. In the second case, A is not large enough to satisfy this condition. In the first case, 
the envelope (Fig. 7.38d) has the same shape as m(t) (although riding on a dc of magnitude A). In the second case the envelope shape 
is not m(t), for some parts get rectified (Fig. 7.38e). Thus, we can detect the desired signal m(t) by detecting the envelope in the first 
case. In the second case, such a detection is not possible. We shall see that envelope detection is an extremely simple and 
inexpensive operation, which does not require generation of a local carrier for the demodulation. But as just noted, the envelope of AM 
has the information about m(t) only if the AM signal [A + m(t)] cos Wet satisfies the condition A + m(t) > 0 for all t. Thus, the condition 
for envelope detection of an AM signal is 


A+m(t)>0 forall (7.74) 


If Mp is the peak amplitude (positive or negative) of m(t) then condition (7.74) is equivalent tolT] 


A>m, (7.75) 


Thus the minimum carrier amplitude required for the viability of envelope detection is mp. This point is clearly illustrated in Fig. 7.38. 
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Figure 7.38: An AM signal (a) for two values of A (b, c) and the respective envelopes (d, e) 


We define the modulation index wu as 


sg 
w= (7.76) 


where A is the carrier amplitude. Note that mp is a constant of the signal m(t). Because A = mp and because there is no upper bound 
on A, it follows that 


O<p<l (7.77) 
as the required condition for the viability of demodulation of AM by an envelope detector. 
When A < mp, Eq. (7.76) shows that y > 1 (overmodulation, shown in Fig. 7.38e). In this case, the option of envelope detection is no 
longer viable. We then need to use synchronous demodulation. Note that synchronous demodulation can be used for any value of u 


(see Prob. 7.7-6). The envelope detector, which is considerably simpler and less expensive than the synchronous detector, can be used 
only when wu < 1. 


EXAMPLE 7.23 
Sketch ayy for modulation indices of uy = 0.5 (50% modulation) and yu = 1 (100% modulation), when m(t) = B cos Wt. This case is 
referred to as tone modulation because the modulating signal is a pure sinusoid (or tone). 


In this case, Mp = B and the modulation index according to Eq. (7.76) is 


algae 


Hence, B=wuAand 
mt) = Bcos@nl = LA COS Wml 


Therefore 
Pay (t) = [A + m(t)] cos e@,t = Al] + COS pf] COS wet (7.78) 


The modulated signals corresponding to u = 0.5 and u = 1 appear in Fig. 7.39a and 7.39b, respectively. 
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Figure 7.39: Tonetiadaaies AM: (a) U = 05 and (b) wu = 1. 


DEMODULATION OF AM: THE ENVELOPE DETECTOR 
The AM signal can be demodulated coherently by a locally generated carrier (see Prob. 7.7-6). Since, however, coherent, or 
synchronous, demodulation of AM (with uw < 1) will defeat the very purpose of AM, it is rarely used in practice. We shall consider here 


one of the noncoherent methods of AM demodulation, envelope detection.!T1 


In an envelope detector, the output of the detector follows the envelope of the (modulated) input signal. The circuit illustrated in Fig. 
7.40a functions as an envelope detector. During the positive cycle of the input signal, the diode conducts and the capacitor C charges 
up to the peak voltage of the input signal (Fig. 7.40b). As the input signal falls below this peak value, the diode is cut off, because the 
capacitor voltage (which is very nearly the peak voltage) is greater than the input signal voltage, a circumstance causing the diode to 
open. The capacitor now discharges through the resistor R at a slow rate (with a time constant RC). During the next positive cycle, the 
same drama repeats. When the input signal becomes greater than the capacitor voltage, the diode conducts again. The capacitor again 
charges to the peak value of this (new) cycle. As the input voltage falls below the new peak value, the diode cuts off again and the 
capacitor discharges slowly during the cutoff period, a process that changes the capacitor voltage very slightly. 


Figure 7.40: Demodulation by means of envelope detector. 


In this manner, during each positive cycle, the capacitor charges up to the peak voltage of the input signal and then decays slowly until 
the next positive cycle. Thus, the output voltage u,(t) follows closely the envelope of the input. The capacitor discharge between 
positive peaks, however, causes a ripple signal of frequency Ww, in the output. This ripple can be reduced by increasing the time 
constant RC so that the capacitor discharges very little between the positive peaks (RC >> 1/w,). Making RC too large, however, would 
make it impossible for the capacitor voltage to follow the envelope (see Fig. 7.40b). Thus, RC should be large in comparison to 1/¢ but 
small in comparison to 1/2Tt B, where B is the highest frequency in m/(t). Incidentally, these two conditions also require that WwW, >> 211 
B, a condition necessary for a well-defined envelope. 


The envelope-detector output u,(f) is A + m(t) plus a ripple of frequency we. The dc term A can be blocked out by a capacitor or a 


simple RC highpass filter. The ripple is reduced further by another (lowpass) RC filter. In the case of audio signals, the speakers also 
act as lowpass filters, which further enhances suppression of the high-frequency ripple. 


7.7-3 Single-Sideband Modulation (SSB) 


Now consider the baseband spectrum M(w) (Fig. 7.41a) and the spectrum of the DSB-SC modulated signal m(t) cos Wet (Fig. 7.41b). 
The DSB spectrum in Fig. 7.41b has two sidebands: the upper and the lower (USB and LSB), both containing complete information on 
M(w)) [see Eqs. (7.11)]. Clearly, it is redundant to transmit both sidebands, a process that requires twice the bandwidth of the baseband 
signal. A scheme in which only one sideband is transmitted is known as single-sideband (SSB) transmission, which requires only half 
the bandwidth of the DSB signal. Thus, we transmit only the upper sidebands (Fig. 7.41c) or only the lower sidebands (Fig. 7.41d). 


—_— 


Figure 7.41: Spectra for single-sideband transmission: (a) baseband, (b) DSB, (c) USB, (d) LSB, and (e) synchronously 
demodulated signal. 


An SSB signal can be coherently (synchronously) demodulated. For example, multiplication of a USB signal (Fig. 7.41c) by 2 cos Wet 
shifts its spectrum to the left and to the right by We, yielding the spectrum in Fig. 7.41e. Lowpass filtering of this signal yields the 
desired baseband signal. The case is similar with an LSB signal. Hence, demodulation of SSB signals is identical to that of DSB-SC 
signals, and the synchronous demodulator in Fig. 7.37a can demodulate SSB signals. Note that we are talking of SSB signals without 
an additional carrier. Hence, they are suppressed-carrier signals (SSB-SC). 


EXAMPLE 7.24 
Find the USB (upper sideband) and LSB (lower sideband) signals when m(t) = cos W,yt. Sketch their spectra, and show that these 
SSB signals can be demodulated using the synchronous demodulator in Fig. 7.37a. 


The DSB-SC signal for this case is 


Posp-sc lt) = M(T) COS @el 


COS Wyt COS Wel 


= i[cos (@- — Wm )t + COS (@- + Wm, )t] (7.79) 


As pointed out in Example 7.21, the terms (1/2) cos (We + Wr)t and (1/2) cos (We — Wry,)t represent the upper and lower sidebands, 
respectively. The spectra of the upper and lower sidebands are given in Fig. 7.42a and 7.42b. Observe that these spectra can be 
obtained from the DSB-SC spectrum in Fig. 7.36b by using a proper filter to suppress the undesired sidebands. For instance, the USB 
signal in Fig. 7.42a can be obtained by passing the DSB-SC signal (Fig. 7.36b) through a highpass filter of cutoff frequency We. 
Similarly, the LSB signal in Fig. 7.42b can be obtained by passing the DSB-SC signal through a lowpass filter of cutoff frequency We. 


If we apply the LSB signal (1/2) cos (W. — Wy) to the synchronous demodulator in Fig. 7.37a, the multiplier output is 
e(t) = 4.00$ (W, — pf COS Wet 
= F[C08 @mt + COS (2, — Om )t] 


The term (1/4) cos (2W,. — Wm) is suppressed by the lowpass filter, producing the desired output (1/4) cos Wyyt [which is m(t)/4]. The 
spectrum of this term is Tt[5(w + Wy) + 5)(W — Wym))/4, as depicted in Fig. 7.42c. In the same way we can show that the USB signal 
can be demodulated by the synchronous demodulator. 
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Figure 7.42: Single-sideband spectra for m(t) = cos Wt: (a) USB, (b) LSB, and (c) synchronously demodulated LSB 
signal. 


In the frequency domain, demodulation (multiplication by cos wt) amounts to shifting the LSB spectrum (Fig. 7.42b) to the left and the 
right by We (times 0.5) and then suppressing the high frequency, as illustrated in Fig. 7.42c. The resulting spectrum represents the 
desired signal (1/4)m(t). 


GENERATION OF SSB SIGNALS 

Two methods are commonly used to generate SSB signals. The selective-filtering method uses sharp cutoff filters to eliminate the 
undesired sideband, and the second method uses phase-shifting networks!*] to achieve the same goal.!t] We shall consider here only 
the first method. 


Selective filtering is the most commonly used method of generating SSB signals. In this method, a DSB-SC signal is passed through a 
sharp cutoff filter to eliminate the undesired sideband. 


To obtain the USB, the filter should pass all components above We, unattenuated and completely suppress all components below We. 
Such an operation requires an ideal filter, which is unrealizable. It can, however, be realized closely if there is some separation between 
the passband and the stopband. Fortunately, the voice signal provides this condition, because its spectrum shows little power content at 
the origin (Fig. 7.43). Moreover, articulation tests show that for speech signals, frequency components below 300 Hz are not important. 
In other words, we may suppress all speech components below 300 Hz without appreciably affecting intelligibility.{71 Thus, filtering of the 
unwanted sideband becomes relatively easy for speech signals because we have a 600 Hz transition region around the cutoff frequency 
W,. For some signals, which have considerable power at low frequencies (around w = 0), SSB techniques cause considerable 
distortion. Such is the case with video signals. Consequently, for video signals, instead of SSB, we use another technique, the vestigial 
sideband (VSB), which is a compromise between SSB and DSB. It inherits the advantages of SSB and DSB but avoids their 
disadvantages at a cost of slightly increased bandwidth. VSB signals are relatively easy to generate, and their bandwidth is only slightly 
(typically 25%) greater than that of the SSB signals. In VSB signals, instead of rejecting one sideband completely (as in SSB), we 


accept a gradual cutoff from one sideband!4]. 


Relative power 
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Figure 7.43: Voice Spectrum. 


7.7-4 Frequency-Division Multiplexing 


Signal multiplexing allows transmission of several signals on the same channel. Later, in Chapter 8 (Section 8.2-2), we shall discuss 
time-division multiplexing (TDM), where several signals time-share the same channel, such as a cable or an optical fiber. In frequency- 
division multiplexing (FDM), the use of modulation, as illustrated in Fig. 7.44, makes several signals share the band of the same 
channel. Each signal is modulated by a different carrier frequency. The various carriers are adequately separated to avoid overlap (or 
interference) between the spectra of various modulated signals. These carriers are referred to as subcarriers. Each signal may use a 
different kind of modulation, for example, DSB-SC, AM, SSB-SC, VSB-SC, or even other forms of modulation, not discussed here [such 
as FM (frequency modulation) or PM (phase modulation)]. The modulated-signal spectra may be separated by a small guard band to 
avoid interference and to facilitate signal separation at the receiver. 


Figure 7.44: Frequency-division multiplexing: (a) FDM spectrum (b) transmitter, and (c) receiver. 


When all the modulated spectra are added, we have a composite signal that may be considered to be a new baseband signal. 
Sometimes, this composite baseband signal may be used to further modulate a high-frequency (radio frequency, or RF) carrier for the 
purpose of transmission. 


At the receiver, the incoming signal is first demodulated by the RF carrier to retrieve the composite baseband, which is then bandpass- 
filtered to separate the modulated signals. Then each modulated signal is individually demodulated by an appropriate subcarrier to 
obtain all the basic baseband signals. 


[*]The term baseband is used to designate the band of frequencies of the signal delivered by the source or the input transducer. 


[t]Practical factors may impose additional restriction on We. For instance, in broadcast applications, a radiating antenna can radiate only 
a narrow band without distortion. This restriction implies that to avoid distortion caused by the radiating antenna, w,/2T B>> 1. The 
broadcast band AM radio, for instance, with B = 5 kHz and the band of 550-1600 kHz for carrier frequency give a ratio of w,/2T B 
roughly in the range of 100-300. 


[tlThe term suppressed carrier does not necessarily mean absence of the spectrum at the carrier frequency. "Suppressed carrier" 
merely implies that there is no discrete component of the carrier frequency. Since no discrete component exists, the DSB-SC spectrum 
does not have impulses at +We,, which further implies that the modulated signal m(t) cos wt does not contain a term of the form k cos 
Wt [assuming that m(t) has a zero mean value]. 


[Tin case the negative and the positive peak amplitudes are not identical, mp in condition (7.75) is the absolute negative peak 
amplitude. 


[tlThere are also other methods of noncoherent detection. The rectifier detector consists of a rectifier followed by a lowpass filter. This 
method is also simple and almost as inexpensive as the envelope detector.!4] The nonlinear detector, although simple and inexpensive, 


results in a distorted output. 
[TILathi, B. P. Modern Digital and Analog Communication Systems, 3rd ed. Oxford University Press, New York, 1998. 


[tlYet another method, known as Weaver's method, is also used to generate SSB signals. 


[tlSimilarly, suppression of components of a speech signal above 3500 Hz causes no appreciable change in intelligibility. 


7.8 DATA TRUNCATION: WINDOW FUNCTIONS 


We often need to truncate data in diverse situations from numerical computations to filter design. For example, if we need to compute 


numerically the Fourier transform of some signal, say e 'u(t), we will have to truncate the signal e'u(t) beyond a sufficiently large 
value of t (typically five time constants and above). The reason is that in numerical computations, we have to deal with date of finite 
duration. Similarly, the impulse response h(t) of an ideal lowpass filter is noncausal and approaches zero asymptotically as |t| — oo. For 
a practical design, we may want to truncate h(t) beyond a sufficiently large value of |¢| to make h(t) causal and of finite duration. In 
signal sampling, to eliminate aliasing, we must use an antialiasing filter to truncate the signal spectrum beyond the half-sampling 
frequency w,/2. Again, we may want to synthesize a periodic signal by adding the first n harmonics and truncating all the higher 
harmonics. These examples show that data truncation can occur in both time and frequency domains. On the surface, truncation 
appears to be a simple problem of cutting off the data at a point at which values are deemed to be sufficiently small. Unfortunately, this 
is not the case. Simple truncation can cause some unsuspected problems. 


WINDOW FUNCTIONS 

Truncation operation may be regarded as multiplying a signal of a large width by a window function of a smaller (finite) width. Simple 
truncation amounts to using a rectangular window W p(t) (shown later in Fig. 7.47a) in which we assign unit weight to all the data within 
the window width (|t| < 7/2), and assign zero weight to all the data lying outside the window (|¢| > 7/2). It is also possible to use a 
window in which the weight assigned to the data within the window may not be constant. In a triangular window w)7(t), for example, the 
weight assigned to data decreases linearly over the window width (shown later in Fig. 7.47b). 


Consider a signal x(t) and a window function wv(f). If x(t) <=> X(w) and w(t) w W(w), and if the windowed function x,)(t) <=> X,(w), 
then 


l 
Xw(t) = x(t)w(t) and Xy(@) = Fp fo) * Wo) 


According to the width property of convolution, it follows that the width of X,) (Ww) equals the sum of the widths of X (w) and W(w). 
Thus, truncation of a signal increases its bandwidth by the amount of bandwidth of w(t). Clearly, the truncation of a signal causes its 
spectrum to spread (or smear) by the amount of the bandwidth of u(t). Recall that the signal bandwidth is inversely proportional to the 
signal duration (width). Hence, the wider the window, the smaller its bandwidth, and the smaller the spectral spreading. This result is 
predictable because a wider window means that we are accepting more data (closer approximation), which should cause smaller 
distortion (smaller spectral spreading). Smaller window width (poorer approximation) causes more spectral spreading (more distortion). 
In addition, since W (vw) is really not strictly bandlimited and its spectrum — 0 only asymptotically, the spectrum of X,) (w) — 0 
asymptotically also at the same rate as that of W (w), even if the X (w) is in fact strictly bandlimited. Thus, windowing causes the 
spectrum of X (w), to spread into the band where it is supposed to be zero. This effect is called leakage. The following example clarifies 
these twin effects, the spectral spreading and the leakage. 


Let us consider x(t) = cos Wof and a rectangular window wWA(t) = rect(t/7), illustrated in Fig. 7.45b. The reason for selecting a sinusoid 
for x(t) is that its spectrum consists of spectral lines of zero width (Fig. 7.45a). Hence, this choice will make the effect of spectral 
spreading and leakage easily discernible. The spectrum of the truncated signal x,,(f) is the convolution of the two impulses of X (Ww) 
with the sinc spectrum of the window function. Because the convolution of any function with an impulse is the function itself (shifted at 
the location of the impulse), the resulting spectrum of the truncated signal is 1/2Tt times the two sinc pulses at tWg, as depicted in Fig. 
7.45c (also see Fig. 7.26). Comparison of spectra X (w) and X,) (Ww) reveals the effects of truncation. These are: 


1. The spectral lines of X (w) have zero width. But the truncated signal is spread out by 217 about each spectral line. The 
amount of spread is equal to the width of the mainlobe of the window spectrum. One effect of this spectral spreading (or 
smearing) is that if x(t) has two spectral components of frequencies differing by less than 411/T rad/s (2/T Hz), they will be 
indistinguishable in the truncated signal. The result is loss of spectral resolution. We would like the spectral spreading 
[mainlobe width of W (w)] to be as small as possible. 


2. In addition to the mainlobe spreading, the truncated signal has sidelobes, which decay slowly with frequency. The 
spectrum of x(t) is zero everywhere except at two. On the other hand, the truncated signal spectrum X,(w) is zero 
nowhere because of the sidelobes. These sidelobes decay asymptotically as 1/w. Thus, the truncation causes spectral 
leakage in the band where the spectrum of the signal x(t) is zero. The peak sidelobe magnitude is 0.217 times the 
mainlobe magnitude (13.3 dB below the peak mainlobe magnitude). Also, the sidelobes decay at a rate 1/w, which is —6 
dB/octave (or /20 dB/decade). This is the sidelobes rolloff rate. We want smaller sidelobes with a faster rate of decay (high 
rolloff rate). Figure 7.45d, which plots |Wp(w)| as a function of w, clearly shows the mainlobe and sidelobe features, with 
the first sidelobe amplitude —13.3 dB below the mainlobe amplitude and the sidelobes decaying at a rate of —6 dB/octave 
(or —20 dB/decade). 
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Figure 7.45: Windowing and its effects. 


So far, we have discussed the effect on the signal spectrum of signal truncation (truncation in the time domain). Because of the time- 
frequency duality, the effect of spectral truncation (truncation in frequency domain) on the signal shape is similar. 


REMEDIES FOR SIDE EFFECTS OF TRUNCATION 


For better results, we must try to minimize the twin side effects of truncations: spectral spreading (mainlobe width) and leakage 
(sidelobe). Let us consider each of these ills. 


1. 


The spectral spread (mainlobe width) of the truncated signal is equal to the bandwidth of the window function w(t). We 
know that the signal bandwidth is inversely proportional to the signal width (duration). Hence, to reduce the spectral 
spread (mainlobe width), we need to increase the window width. 


. To improve the leakage behavior, we must search for the cause of the slow decay of sidelobes. In Chapter 6, we saw that 


the Fourier spectrum decays as 1/w for a signal with jump discontinuity, decays as 1/u)2 for a continuous signal whose 
first derivative is discontinuous, and so on.!t] Smoothness of a signal is measured by the number of continuous 
derivatives it possesses. The smoother the signal, the faster the decay of its spectrum. Thus, we can achieve a given 
leakage behavior by selecting a suitably smooth (tapered) window. 


. For a given window width, the remedies for the two effects are incompatible. If we try to improve one, the other 


deteriorates. For instance, among all the windows of a given width, the rectangular window has the smallest spectral 
spread (mainlobe width), but its sidelobes have high level and they decay slowly. A tapered (smooth) window of the same 
width has smaller and faster decaying sidelobes, but it has a wider mainlobe.!t] But we can compensate for the increased 
mainlobe width by widening the window. Thus, we can remedy both the side effects of truncation by selecting a suitably 
smooth window of sufficient width. 


There are several well-known tapered-window functions, such as Bartlett (triangular), Hanning (von Hann), Hamming, Blackman, and 
Kaiser, which truncate the data gradually. These windows offer different trade-offs with respect to spectral spread (mainlobe width), the 


peak sidelobe magnitude, and the leakage rolloff rate as indicated in Table 7a, [6] Observe that all windows are symmetrical about 
the origin (even functions of t). Because of this feature, W (w) is a real function of w; that is, 7W(w) is either 0 or Tr. Hence, the 
phase function of the truncated signal has a minimal amount of distortion. 


Figure 7.46 shows two well-known tapered-window functions, the von Hann (or Hanning) window Wyan(x) and the Hamming window 
WHAM(X). We have intentionally used the independent variable x because windowing can be performed in the time domain as well as in 
the frequency domain; so x could be t or w, depending on the application. 


Woal*) 


(a) (b) 


Figure 7.46: (a) Hanning and (b) Hamming windows. 


There are hundreds of windows, all with different characteristics. But the choice depends on a particular application. The rectangular 
window has the narrowest mainlobe. The Bartlett (triangle) window (also called the Fejer or Cesaro) is inferior in all respects to the 
Hanning window. For this reason it is rarely used in practice. Hanning is preferred over Hamming in spectral analysis because it has 
faster sidelobe decay. For filtering applications, on the other hand, the Hamming window is chosen because it has the smallest sidelobe 
magnitude for a given mainlobe width. The Hamming window is the most widely used general-purpose window. The Kaiser window, 
which uses /9(c), the modified zero-order Bessel function, is more versatile and adjustable. Selecting a proper value of « (0 < « < 10) 
allows the designer to tailor the window to suit a particular application. The parameter « controls the mainlobe-sidelobe tradeoff. When 
a = 0, the Kaiser window is the rectangular window. For « = 5.4414, it is the Hamming window, and when « = 8.885, it is the 
Blackman window. As « increases, the mainlobe width increases and the sidelobe level decreases. 


Table 7.3: Some Window Functions and Their Characteristics 
=> Open table as spreadsheet 


Window w(t) Mainlobe Rolloff Rate Peak Sidelobe level 
Width (dB/oct) (dB) 
t dn —13.3 
Rectangular: rect T T 
pcan Act 87 —26.5 
rtlett: — ma 
artle oT 7 
2xt 87 —31.5 
Hanning: 0.5 [ + cos (=) T 
8a —42.7 
Y ie 
127 —58.1 
Blackman: 0.42 + 0.5 cos cl + 0.08 cos mis a 
a T 1 
iT: 


2nt 
Hamming: 0.54 + 0.46 cos (=) 


2n —59.9 (x = 8.168) 
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Kaiser; ——————_ 0 < a < 10 


7.8-1 Using Windows in Filter Design 


We shall design an ideal lowpass filter of bandwidth W rad/s, with frequency response H(w), as shown in Fig. 7.47e or 7.47f. For this 
filter, the impulse response h(t) = (W/tTr) sinc (Wt) (Fig. 7.47c) is noncausal and, therefore, unrealizable. Truncation of h(t) by a 
suitable window (Fig. 7.47a) makes it realizable, although the resulting filter is now an approximation to the desired ideal filter.[T] We 
shall use a rectangular window Wp(t) and a triangular (Bartlett) window w7(f) to truncate h(t), and then examine the resulting filters. 
The truncated impulse responses hp(t) = h(t)wa(t) and h7(t) = h(t)w7(t) are depicted in Fig. 7.47d. Hence, the windowed filter 
frequency response is the convolution of H(w) with the Fourier transform of the window, as illustrated in Fig. 7.47e and 7.47f. We make 
the following observations. 


1. The windowed filter spectra show spectral spreading at the edges, and instead of a sudden switch there is a gradual 
transition from the passband to the stopband of the filter. The transition band is smaller (21t/T rad/s) for the rectangular 
case than for the triangular case (4tt/T rad/s). 


2. Although H(w) is bandlimited, the windowed filters are not. But the stopband behavior of the triangular case is superior to 
that of the rectangular case. For the rectangular window, the leakage in the stopband decreases slowly (as 1/w) in 


comparison to that of the triangular window (as 1/w2). Moreover, the rectangular case has a higher peak sidelobe 
amplitude than that of the triangular window. 
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[T]This result was demonstrated for periodic signals. However, it applies to aperiodic signals also. This is because we showed in the 
beginning of this chapter that if x79(t) is a periodic signal formed by periodic extension of an aperiodic signal x(t), then the spectrum of 
XTo(t) is (1/To times) the samples of X (Ww). Thus, what is true of the decay rate of the spectrum of x7o(f) is also true of the rate of 
decay of X (Ww). 


[tla tapered window yields a higher mainlobe width because the effective width of a tapered window is smaller than that of the 
rectangular window; see Section 2.7-2 [Eq. (2.67)] for the definition of effective width. Therefore, from the reciprocity of the signal width 
and its bandwidth, it follows that the rectangular window mainlobe is narrower than a tapered window. 


[5]Hamming, R. W. Digital Filters, 2nd ed. Prentice-Hall, Englewood Cliffs, NJ, 1983. 


[6]Harris. F. J. On the use of windows for harmonic analysis with the discrete Fourier transform. Proceedings of the IEEE, vol. 66, no. 
1, pp. 51-83, January 1978. 


[T]In addition to truncation, we need to delay the truncated function by 7/2 to render it causal. However, the time delay only adds a 
linear phase to the spectrum without changing the amplitude spectrum. Thus, to simplify our discussion, we shall ignore the delay. 


7.9 SUMMARY 


In Chapter 6, we represented periodic signals as a sum of (everlasting) sinusoids or exponentials (Fourier series). In this chapter we 
extended this result to aperiodic signals, which are represented by the Fourier integral (instead of the Fourier series). An aperiodic 
signal x(t) may be regarded as a periodic signal with period Tg — ©, so that the Fourier integral is basically a Fourier series with a 
fundamental frequency approaching zero. Therefore, for aperiodic signals, the Fourier spectra are continuous. This continuity means 
that a signal is represented as a sum of sinusoids (or exponentials) of all frequencies over a continuous frequency interval. The Fourier 
transform X(u), therefore, is the spectral density (per unit bandwidth in hertz). 


An ever present aspect of the Fourier transform is the duality between time and frequency, which also implies duality between the 
signal x(t) and its transform X(u). This duality arises because of near-symmetrical equations for direct and inverse Fourier transforms. 
The duality principle has far-reaching consequences and yields many valuable insights into signal analysis. 


The scaling property of the Fourier transform leads to the conclusion that the signal bandwidth is inversely proportional to signal 
duration (signal width). Time-shifting of a signal does not change its amplitude spectrum, but it does add a linear phase component to 


its spectrum. Multiplication of a signal by an exponential e/0T shifts the spectrum to the right by w®. In practice, spectral shifting is 
achieved by multiplying a signal by a sinusoid such as cos Wof (rather than the exponential Wot). This process is known as amplitude 


modulation. Multiplication of two signals results in convolution of their spectra, whereas convolution of two signals results in 
multiplication of their spectra. 


For an LTIC system with the frequency response H(w), the input and output spectra X(w) are Y(w) are related by the equation Y(w) = 
X(W)H(w). This is valid only for asymptotically stable systems. It also applies to marginally stable systems if the input does not contain 
a finite amplitude sinusoid of the natural frequency of the system. For asymptotically unstable systems, the frequency response H(w) 
does not exist. For distortionless transmission of a signal through an LTIC system, the amplitude response |H(w)| of the system must 
be constant, and the phase response 2H(w) should be a linear function of w over a band of interest. Ideal filters, which allow 
distortionless transmission of a certain band of frequencies and suppress all the remaining frequencies, are physically unrealizable 


(noncausal). In fact, it is impossible to build a physical system with zero gain [H(w) = 0] over a finite band of frequencies. Such systems 
(which include ideal filters) can be realized only with infinite time delay in the response. 


The energy of a signal x(t) is equal to 1/211 times the area under |X(w)?| (Parseval's theorem). The energy contributed by spectral 


components within a band Af (in hertz) is given by [X(w)2|AF. Therefore, |X(w)|? is the energy spectral density per unit bandwidth (in 
hertz). 


The process of modulation shifts the signal spectrum to different frequencies. Modulation is used for many reasons: to transmit several 
massages simultaneously over the same channel for the sake of utilizing channel's high bandwidth, to effectively radiate power over a 
radio link, to shift a signal spectrum at higher frequencies to overcome the difficulties associated with signal processing at lower 
frequencies, and to effect the exchange of transmission bandwidth and transmission power required to transmit data at a certain rate. 
Broadly speaking there are two types of modulation, amplitude and angle modulation. Each class has several subclasses. 


In practice, we often need to truncate data. Truncating is like viewing data through a window, which permits only certain portions of the 
data to be seen and hides (suppresses) the remainder. 


Abrupt truncation of data amounts to a rectangular window, which assigns a unit weight to data seen from the window and zero weight 
to the remaining data. Tapered windows, on the other hand, reduce the weight gradually from 1 to 0. Data truncation can cause some 
unsuspected problems. For example, in computation of the Fourier transform, windowing (data truncation) causes spectral spreading 
(spectral smearing) that is characteristic of the window function used. A rectangular window results in the least spreading, but it does so 
at the cost of a high and oscillatory spectral leakage outside the signal band, which decays slowly as 1/w. In comparison to a 
rectangular window, tapered windows in general have larger spectral spreading (smearing), but the spectral leakage is smaller and 
decays faster with frequency. If we try to reduce spectral leakage by using a smoother window, the spectral spreading increases. 
Fortunately, spectral spreading can be reduced by increasing the window width. Therefore, we can achieve a given combination of 
spectral spread (transition bandwidth) and leakage characteristics by choosing a suitable tapered window function of a sufficiently long 
width T. 
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MATLAB SESSION 7: FOURIER TRANSFORM TOPICS 


MATLAB is useful for investigating a variety of Fourier transform topics. In this session, a rectangular pulse is used to investigate the 
scaling property, Parseval's theorem, essential bandwidth, and spectral sampling. Kaiser window functions are also investigated. 


M7.1 The Sinc Function and the Scaling Property 


As shown in Example 7.2, the Fourier transform of x(t) = rect (t/T) is X(w) = T sinc (wT/2). To represent X(Ww) in MATLAB, a sinc 
function is first required.[1] 


function [y] = MS7P1 (x); 
%& MS7P1 .m : MATLAB Session 7, Program 1 
% Function M-file computes the sinc function, y = sin (x)/x. 


y = ones (size(x)); i = find(x ~ = 0); 
y (i) = sin (x(i))./x(i); 


The computational simplicity of sinc (x) = sin (x)/x is somewhat deceptive: sin (0)/0 results in a divide-by-zero error. Thus, program 
MS7P1 assigns sinc (0) = 1 and computes the remaining values according to the definition. Notice that MS7P1 cannot be directly 
replaced by an inline object. Inline objects prohibit the defining expression from having multiple lines, using other inline objects, and 
using certain commands such as = , if, or for. M-files, however, can be used to define an inline object. For example, MS7P1 helps 
represent X(w) as an inline object. 


>> X = inline ('tau*MS7P1(omega*tau/2)', 'omega', 'tau'); 


Once we have defined X(w), it is simple to investigate the effects of scaling the pulse width Tt. Consider the three cases T = 1.0, T = 
0.5, and T = 2.0. 


>> omega = linspace(-4*pi,4*pi,200); 

>> plot (omega,X(omega,1),'k-'omega, X(omega,0.5),'k:',omega,X(omega,2),'k--"'); 
>> grid; axis tight; xlabel ('\omega'); ylabel('X(\omega)'); 

>> legend('Baseline (\tau = 1)','Compressed (\tau = 0.5)',... 

Expanded (\tau = 2.0)'); 


Figure M7.1 confirms the reciprocal relationship between signal duration and spectral bandwidth: time compression causes spectral 
expansion, and time expansion causes spectral compression. Additionally, spectral amplitudes are directly related to signal energy. As a 
signal is compressed, signal energy and thus spectral magnitude decrease. The opposite effect occurs when the signal is expanded. 
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Figure M7.1: Pulse spectra for T = 1.0, T = 0.5, and T = 2.0. 


M7.2 Parseval's Theorem and Essential Bandwidth 


Parseval's theorem concisely relates energy between the time domain and the frequency domain: 


f Ix(t)|? dt = = / |X(w)|* dw 
Z 2% Jo 


oo 


This too is easily verified with MATLAB. For example, a unit amplitude pulse x(t) with duration T has energy E, = T. Thus, 


Xx 
/ |X (w@) |? dw = 22t 
OO 

Letting T = 1, the energy of X(w) is computed by using the quad function. 


>> X_squared = inline('(tau*MS7P1 (omega*tau/2)). *2','omega','tau'); 
>> quad (X squared,-leo,le6, [], [], 1) 
ans = 6.2817 


Although not perfect, the result of the numerical integration is consistent with the expected value of 21 ~ 6.2832. For quad, the first 
argument is the function to be integrated, the next two arguments are the limits of integration, the empty square brackets indicate 
default values for special options, and the last argument is the secondary input T for the inline function X_ squared. Full format details 
for quad are available from MATLAB's help facilities. 


A more interesting problem involves computing a signal's essential bandwidth. Consider, for example, finding the essential bandwidth W, 
in radians per second, that contains fraction B of the energy of the square pulse x(t). That is, we want to find W such that 


1 W 
| |X(w)|* dw = pr 
2n Wv 


Program MS7P2 uses a guess-and-check method to find W. 
function [W,E W] = MS7P2 (tau,beta,tol) 


% MS7P2.m : MATLAB Session 7, Program 2 

% Function M-file computes essential bandwidth W for square pulse. 
% INPUTS: tau = pulse width 

% beta = fraction of signal energy desired in W 

% tol = tolerance of relativ nergy error 

% OUTPUTS: W = essential bandwidth [rad/s] 

% EF W = Energy contained in bandwidth W 

W = 0; step = 2*pi/tau; % Initial guess and step values 

X squared = inline('(tau*MS7P1 (omega*tau/2)).*2','omega','tau'); 
E = beta*tau; % Desired energy in W 

relerr = (E-0)/E; % Initial relative error is 100 percent 
while(abs(relerr) > tol), 

if (relerr>0), % W too small 

W=W + step; % Increase W by step 

elseif (relerr<0), % W too large 

step = step/2; W = W-step; % Decrease step size and then W. 

end 


E W = 1/(2*pi)*quad(X squared,-W,W, [], [],tau); 


relerr = (E - E_W)/E; 
end 


Although this guess-and-check method is not the most efficient, it is relatively simple to understand: MS7P2 sensibly adjusts W until the 
relative error is within tolerance. The number of iterations needed to converge to a solution depends on a variety of factors and is not 
known beforehand. The while command is ideal for such situations: 

while expression, 


statements; 
end 


While the expression is true, the statements are continually repeated. 


To demonstrate MS7p2, consider the 90% essential bandwidth W for a pulse of one second duration. Typing [W, EW] = MS7p2 
(1,0.9,0.001) returns an essential bandwidth W = 5.3014 that contains 89.97% of the energy. Reducing the error tolerance 
improves the estimate. MS7P2 (1,0.9, 0.00005) returns an essential bandwidth W = 5.3321 that contains 90.00% of the energy. 
These essential bandwidth calculations are consistent with estimates presented after Example 7.2. 


M7.3 Spectral Sampling 


Consider a signal with finite duration T. A periodic signal x79(t) is constructed by repeating x(t) every Tg seconds, where Typ = T. From 
Eq. (7.4) we can write the Fourier coefficients of xzo(t) as Dp, = (1/T9)X(n211/To). Put another way, the Fourier coefficients are 
obtained by sampling the spectrum X(w). 


By using spectral sampling, it is simple to determine the Fourier series coefficients for an arbitrary duty-cycle square-pulse periodic 
signal. The square pulse x(t) = rect (t/T) has spectrum X(w) = T sinc (wT/2). Thus, the nth Fourier coefficient of the periodic extension 
X7o(t) is Dy = (T/To) sinc (nttT/Tg). As in Example 6.4, T = TT and To = 2 Tt provide a square-pulse periodic signal. The Fourier 
coefficients are determined by 


>> tau = pi; TO = 2*pi; n = [0:10]; 

>> Dn = tau/T O*MS7P1 (n*pi*tau/T 0); 

>> stem (n, Dn); xlabel ('n'); ylabel ('D n'); 
>> axis ([-0.5 10.5 -0.2 0.55]); — 


The results, shown in Fig. M7.2, agree with Fig. 6.5b. Doubling the period to Tg = 4Tt effectively doubles the spectral sampling, as 
shown in Fig. M7.3. 
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Figure M7.2: Fourier spectra for T = T and To = 2Tr. 
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Figure M7.3: Fourier spectra for T = TT and To = 4Tr. 


As To increases, the spectral sampling becomes progressively finer. An evolution of the Fourier series toward the Fourier integral is 
seen by allowing the period Tg to become large. Figure M7.4 shows the result for Tg = 5O0Tr. 
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Figure M7.4: Fourier spectra for T = TT and Tg = 50 Tr. 


If To = T, the signal x79 is a constant and the spectrum should concentrate energy at dc. In this case, the sinc function is sampled at 
the zero crossings and D, = 0 for all n not equal to 0. Only the sample corresponding to n = 0 is nonzero, indicating a dc signal, as 
expected. It is a simple matter to modify the previous code to verify this case. 


M7.4 Kaiser Window Functions 


A window function is useful only if it can be easily computed and applied to a signal. The Kaiser window, for example, is flexible but 
appears rather intimidating: 


h(a@V/l1 —4(t/T)*) 
—_ \t| < T/2 
wr (t) = In{ar) 


0 otherwise 


Fortunately, the bark of a Kaiser window is worse than its bite! The function /9(x), a zero-order modified Bessel function of the first kind, 
can be computed according to 


Io(x) = (=) 
— 2*k! 


or, more simply, by using the MATLAB function besseli (0,x). In fact, MATLAB supports a wide range of Bessel functions, 
including Bessel functions of the first and second kinds (besselj and bessely), modified Bessel functions of the first and second 
kinds (besseli and besselk), Hankel functions (besselh), and Airy functions (airy). 


Program MS7P3 computes Kaiser windows at times ¢ by using parameters T and a. 


function [w K] = MS7P3 (t, T, alpha) 
MS7P3.m : MATLAB Session 7, Program 3 
Function M-file computes a width-T Kaiser window using parameter alpha, 
Alpha can also be a string identifier: 'rectangular', 'Hamming', or 
"Blackman'. 
INPUTS: c independent variable of the window function 
T window width 
alpha = Kaiser parameter or string identifier 
OUTPUTS: w K = Kaiser window function 
if strncempi (alpha, 'rectangular', 1), 
alpha = 0; 
elseif strncmpi (alpha, 'Hamming', 3), 
alpha = 5.4414; 
elseif strncmpi (alpha, 'Blackman', 1), 
alpha = 8.885; 
elseif isa(alpha, 'char') 


AP AIP AIP oP AP AIP AIP DP 


disp ('Unrecognized string identifier.'); return 

end 

w_K = zeros (size (t)); i = find (abs (t) <T/2); 

w K(i) = besseli (0, alpha*sqrt (1-4*t(i). *2/(T*2)))/besseli (0,alpha) ; 


Recall that « = 0, « = 5.4414, and « = 8.885 correspond to rectangular, Hamming, and Blackman windows, respectively. MS7P3 is 
written to allow these special-case Kaiser windows to be identified by name rather than by « value. While unnecessary, this convenient 
feature is achieved with the help of the strncmpi command. 


The strncmpi (S1, S2, N) command compares the first N characters of strings S1 and S2, ignoring case. More completely, 
MATLAB has four variants of string comparison: strcmp, strcmpi, strncmp, and strncmpi. Comparisons are restricted to the first 
N characters when n is present; case is ignored when i is present. Thus, MS7P3 identifies any string alpha that starts with the letter r 
or R as a rectangular window. To prevent confusion with a Hanning window, the first three characters must match to identify a Hamming 
window. The isa (alpha, 'char') command determines whether alpha is a character string. MATLAB help documents the many 
other classes that isa can identify. InMS7P3, isa is used to terminate execution if a string identifier alpha has not been recognized 
as one of the three special cases. 


Figure M7.5 shows the three special-case, unit duration Kaiser windows generated by 


>> t = [-0.6:.001:0.6]; T = 1; 
>> plot (t, MS7P3 (t, T, '‘'r'), 'k-', t, MS7P3 (t, T, 'ham'), 'k:', t,MS7P3 (t, T, 'b'), 'k--'); 
>> axis ([-0.6 0.6 -.1 1.1]); xlabel ('t'); ylabel ('w K(t)'); 

>> legend ('Rectangular', 'Hamming', 'Blackman') ; ns 
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Figure M7.5: Special-case, unit duration Kaiser windows. 
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[tlThe signal processing toolbox function sinc (x), which computes (sin (11x))/1tx, also works provided that inputs are scaled by 1/Tr. 


PROBLEMS 


7.1.1. Show that if x(t) is an even function of f, then 


a] 
X(@) = 2 | x(t) cos wt dt 
a 


and if x(t) is an odd function of f, then 


~ 
X(@) = -2j [ x(t) sin wt dt 
0 


Hence, prove that if x(f) is a real and even function of f, then X(uw) is a real and even function of w. In addition, if x(t) is 
a real and odd function of tf, then X(w) is an imaginary and odd function of w. 


7.1.2. Show that for a real x(t), Eq. (7.8b) can be expressed as 
l io) 
x(t) = - | |X (w)| coslwt + 2X (w)| da 
mT Jo 


This is the trigonometric form of the Fourier integral. Compare this with the compact trigonometric Fourier series. 


7.1.3. A signal x(t) can be expressed as the sum of even and odd components (see Section 1.5-2): 
x(t) = xe(t) + x(t) 


a. If x(t) <=> X(w), show that for real x(f), 


x(t) ==> Rel[X(o)] 


and : 
Xo(t) => j In[X()] 

b. Verify these results by finding the Fourier transforms of the even and odd components of the following 
signals: (i) u(t) and (ii) e~ u(t). 


7.1.4 From definition (7.8a), find the Fourier transforms of the signals x(t) in Fig. P7.1-4. 


(a) 
Figure P7.1-4 


7.1.5 From definition (7.8a), find the Fourier transforms of the signals depicted in Fig. P7.1-5. 


Figure P7.1-5 


7.1.6 Use Eq. (7.8b) to find the inverse Fourier transforms of the spectra in Fig. P7.1-6. 
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Figure P7.1-6 


7.1.7 Use Eq. (7.8b) to find the inverse Fourier transforms of the spectra in Fig. P7.1-7. 
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Figure P7.1-7 
7.1.8 — If x(t) <= X(w), then show that 
OO 
X(0) = / x(t) dt 


oo 


and 
l OD 
x(0) = all X(@)da 
ag oo 


Also show that 


oO oD 
/ sine (x) dx = / sinc’ (x)dx =z 


= a) ow 


7.2.1. Sketch the following functions: 
a. rect (t/2) 
b. A(3w/100) 
c. rect ((f— 10)/8) 
d. sinc (trw/5) 
e. sinc ((w/5) — 21) 


f. sinc (t/5) rect (t/10TT) 


7.2.2 From definition (7.8a), show that the Fourier transform of rect (tf — 5) is sinc (w/2)e J, Sketch the resulting amplitude 
and phase spectra. 


7.2.3 ° From definition (7.8b), show that the inverse Fourier transform of rect ((w — 10)/21t) is sinc (tt)e/"%. 


7.24 — Find the inverse Fourier transform of Xw) for the spectra illustrated in Fig. P7.2-4. [Hint: X(w) = |X(w)| e/<*(“). This 
problem illustrates how different phase spectra (both with the same amplitude spectrum) represent entirely different 
signals.] 


a. Can you find the Fourier transform of e@u(t) when a > 1 by setting s = w in its Laplace transform of 
e*y(t)? Explain. 


b. Find the Laplace transform of x(t) shown in Fig. P7.2-5. Can you find the Fourier transform of x(t) by 
setting s = jw in its Laplace transform? Explain. Verify your answer by finding the Fourier and the Laplace 
transforms of x(f). 
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Figure P7.2-5 
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Figure P7.2-4 
7.3.1 Apply the duality property to the appropriate pair in Table 7.1 to show that 
a. 1/2[8(t) + jit] <> u(w) 
b. S(t + 7) + S(t — T) <= 2cos Tw 
c. &(t + T) + O(t — T) <= 2jsin Tw 


7.3.2 The Fourier transform of the triangular pulse x(t) in Fig. P7.3-2 is expressed as 


X(o) = A (ie — joel” — 1) 
an 


Use this information, and the time-shifting and time-scaling properties, to find the Fourier transforms of the signals x;(t)(/ 
= 1, 2, 3, 4, 5) shown in Fig. P7.3-2. 
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Figure P7.3-2 
7.3.3 Using only the time-shifting property and Table 7.1, find the Fourier transforms of the signals depicted in Fig. P7.3-3. 
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Figure P7.3-3 


7.3.4 Use the time-shifting property to show that if x(t) <= X(uw), then 
x(t+T) + x(t —T) = > 2X(e) cosTow 


This is the dual of Eq. (7.41). Use this result and Table 7.1 to find the Fourier transforms of the signals shown in Fig. 


P7.3-4. 
4 5 2 0 2 3 4 4-3 0 3 4 
fa) tb) 
Figure P7.3-4 


7.3.5 Prove the following results, which are duals of each other: 


1 
x(t)sin oot — 7 *@ — Wp) 
— X(@ + @)] 
she +T)—x(t—T)| — X(o) sin To 


Use the latter result and Table 7.1 to find the Fourier transform of the signal in Fig. P7.3-5. 


-4 


Figure P7.3-5 


7.3.6 


7.3.7 


7.3.8 


7.3.9 


7.3.10 


7.3.11 


The signals in Fig. P7.3-6 are modulated signals with carrier cos 10¢. Find the Fourier transforms of these signals by 
using the appropriate properties of the Fourier transform and Table 7.1. Sketch the amplitude and phase spectra for 
Fig. P7.3-6a and P7.3-6b. 


(a) ib) 


Figure P7.3-6 


Use the frequency-shifting property and Table 7.1 to find the inverse Fourier transform of the spectra depicted in Fig. 
P7.3-7. 


Figure P7.3-7 


Use the time convolution property to prove pairs 2, 4, 13, and 14 in Table 2.1 (assume A < 0 in pair 2, A, and A» <0 in 
pair 4, \4 <0 and Ag > O in pair 13, and A, and Az > 0 in pair 14). These restrictions are placed because of the 
Fourier transformability issue for the signals concerned. For pair 2, you need to apply the result in Eq. (1.23). 


A signal x(t) is bandlimited to B Hz. Show that the signal x”(t) is bandlimited to nB Hz. 
Find the Fourier transform of the signal in Fig. P7.3-3a by three different methods: 

a. By direct integration using the definition (7.8a). 

b. Using only pair 17 (Table 7.1) and the time-shifting property. 


c. Using the time-differentiation and time-shifting properties, along with the fact that 5(t) <=> 1. 


a. Prove the frequency-differentiation property (dual of the time-differentiation property): 


d 
-ji(ti<— —X(w) 
da 


b. Use this property and pair 1 (Table 7.1) to determine the Fourier transform of te u(t). 
7.4.1 For a stable LTIC system with transfer function 
H@)=— 
y=— 
s+1 
find the (zero-state) response if the input x(¢) is 
a. e 2lu(t) 
b. e tu(t) 
c. efu(—t) 
d. u(t) 
7.4.2 | A stable LTIC system is specified by the frequency response 
H(@) = 


jo—2 


Find the impulse response of this system and show that this is a noncausal system. Find the (zero-state) 
response of this system if the input x(f) is 


-t 


7.4.3 


7.4.4 


7.4.5 


7.4.6 


a. e u(t) 
b. efu(—t) 


Signals x4(t) = 104rect (104t) and x(t) = (t) are applied at the inputs of the ideal low-pass filters 
H4(wW) = rect (w/40,000Tr) and Ho(w) = rect(w/20,000TT) (Fig. P7.4-3). The outputs y4(t) and yo(t) of 
these filters are multiplied to obtain the signal y(t) = y4(t)yo(t). 


a. Sketch X4(w) and X9(w). 
b. Sketch H4(w) and H2(w). 
c. Sketch Y;(Ww) and Yo(w). 
d. Find the bandwidths of y(t), yo(t), and y(¢). 
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Figure P7.4-3 


A lowpass system time constant is often defined as the width of its unit impulse response h(t) (see 
Section 2.7-2). An input pulse p(t) to this system acts like an impulse of strength equal to the area of 
p(t) if the width of p(t) is much smaller than the system time constant, and provided p(t) is a lowpass 
pulse, implying that its spectrum is concentrated at low frequencies. Verify this behavior by considering a 


system whose unit impulse response is h(t) = rect(t/10~). The input pulse is a triangle pulse p(t) = 


A(t/10~®). Show that the system response to this pulse is very nearly the system response to the input 
Aé(t), where A is the area under the pulse p(t). 


A lowpass system time constant is often defined as the width of its unit impulse response h(t) (see 
Section 2.7-2). An input pulse p(t) to this system passes practically without distortion if the width of p(t) 
is much greater than the system time constant, and provided p(t) is a lowpass pulse, implying that its 
spectrum is concentrated at low frequencies. Verify this behavior by considering a system whose unit 


impulse response is h(t) = rect (t/107%). The input pulse is a triangle pulse p(t) = A(t). Show that the 
system output to this pulse is very nearly kp(t), where k is the system gain to a dc signal, that is, k = 
H(0). 


A causal signal h(t) has a Fourier transform H(w). If R(w) and X(w) are the real and the imaginary parts 
of H(w), that is, ye R(w) + jX(w), then show that 


R(@) = 2f- Ae) daw 


and 


X(@) = = if" Re) 


rs o— he 


assuming that h(t) has no impulse at the origin. This pair of integrals defines the Hilbert transform. (Hint: 
Let h(t) and h,(t) be the even and odd components of h(t). Use the results in Prob. 7.1-3. See Fig. 
1.24 for the relationship between h,(t) and h,(f).] 


This problem states one of the important properties of causal systems: that the real and imaginary parts 
of the frequency response of a causal system are related. If one specifies the real part, the imaginary 
part cannot be specified independently. The imaginary part is pre-determined by the real part, and vice 
versa. This result also leads to the conclusion that the magnitude and angle of H(w) are related provided 
all the poles and zeros of H(w) lie in the LHP. 


Consider a filter with the frequency response 
H(w) = eo tke? + jot) 


Show that this filter is physically unrealizable by using the time-domain criterion [noncausal h(t)] and the 
frequency-domain (Paley-Wiener) criterion. Can this filter be made approximately realizable by choosing 


7.6.1 


7.6.2 


7.6.4 


to sufficiently large? Use your own (reasonable) criterion of approximate realizability to determine fo. 
[Hint: Use pair 22 in Table 7.1.] 


Show that a filter with frequency response 
2(10°) _, 
H(#) = ———_—e 
a? + 101° 
is unrealizable. Can this filter be made approximately realizable by choosing a sufficiently large tg? Use 
your own (reasonable) criterion of approximate realizability to determine fo. 


Determine whether the filters with the following frequency response H(w) are physically realizable. If 
they are not realizable, can they be realized approximately by allowing a finite time delay in the 
response? 


a. 10-6 sinc (10-8w) 


b. 1074 A (w/40,000tTr) 


c. 2718(W) 
Show that the energy of a Gaussian pulse 
x(t) = e-P /a* 


oJ2zx 

is |/(2Qe Jn). Verify this result by using Parseval's theorem to derive the energy E, from X(w). [Hint: 
ea a _ 

See pair 22 in Table 7.1. Use the fact that Joo@ 4x = J2n_ 


Use Parseval's theorem (7.64) to show that 


OD 
/ sinc? (kx) dx = - 


oO 


A lowpass signal x(t) is applied to a squaring device. The squarer output x(t) is applied to a lowpass 
filter of bandwidth Af (in hertz) (Fig. P7.6-3). Show that if Af is very small (Af — 0), then the filter output 
is a de signal y(t) = 2E,Af. [Hint: if x(t) <=> A(w), then show that Y(w) ~ [411A(0)Af] 8(u) if Af — 0. 
Now, show that A(0) = E,.] 
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Figure P7.6-3 


Generalize Parseval's theorem to show that for real, Fourier-transformable signals x4(t) and x(t) 


Ow 
i x) (1)x2(t) dt 


co 
~ 


1 
— X\(—w)X>2(@) da 
oO 


2x 


1 
=| X\(w)X2(—w) dw 
vgn ieee 


Show that 
OO 
f sinc (Wf — mar) sine (Wt — nz) at 
~~ 
0 men 
1 
—_ m=n 
W 
[Hint: Recognize that 


7.7.1 


kx 
sinc (Wt — kz) = sinc |W | t — — 
sinc ( a) = sinc | ( =| 


<=> rect (—) e-stror 
2W 


Use this fact and the result in Prob. 7.6-4.] 
For the signal 


rH= 


e+a? 


determine the essential bandwidth B (in hertz) of x(t) such that the energy contained in the spectral 
components of x(t) of frequencies below B Hz is 99% of the signal energy Ey. 


For each of the following baseband signals (i) m(t) = cos 1000f, (ii) m(t) = 2cos 1000f + cos 2000t, and 
(iii) m(t) = cos 1000f cos 3000¢: 


a. Sketch the spectrum of m(f). 
b. Sketch the spectrum of the DSB-SC signal m(t) cos 10,000¢. 
c. Identify the upper sideband (USB) and the lower sideband (LSB) spectra. 


d. Identify the frequencies in the baseband, and the corresponding frequencies in the DSB- 
SC, USB, and LSB spectra. Explain the nature of frequency shifting in each case. 


You are asked to design a DSB-SC modulator to generate a modulated signal km(t) cos wet, where m(f) 
is a signal bandlimited to B Hz (Fig. P7.7-2a). Figure P7.7-2b shows a DSB-SC modulator available in 
the stockroom. The bandpass filter is tuned to Ww. and has a bandwidth of 2B Hz. The carrier generator 


available generates not cos Wet, but cos® weft. 


a. Explain whether you would be able to generate the desired signal using only this 
equipment. If so, what is the value of k? 


b. Determine the signal spectra at points b and c, and indicate the frequency bands occupied 
by these spectra. 


c. What is the minimum usable value of w,? 
d. Would this scheme work if the carrier generator output were cos? wt? Explain. 


e. Would this scheme work if the carrier generator output were cos” wf for any integer n = 
2? 


Figure P7.7-2 


In practice, the analog multiplication operation is difficult and expensive. For this reason, in amplitude 
modulators, it is necessary to find some alternative to multiplication of m(t) with cos Wet. Fortunately, for 
this purpose, we can replace multiplication with switching operation. A similar observation applies to 
demodulators. In the scheme depicted in Fig. P7.7-3a, the period of the rectangular periodic pulse x(t) 
shown in Fig. P7.7-3b is Tg = 21t/We.. The bandpass filter is centered at tw, and has a bandwidth of 2B 
Hz. Note that multiplication by a square periodic pulse x(t) in Fig. P7.7-3b amounts to periodic on-off 
switching of m(t), which is bandlimited to B Hz. Such a switching operation is relatively simple and 
inexpensive. 


Show that this scheme can generate an amplitude-modulated signal k cos wt. Determine the value of k. 
Show that the same scheme can also be used for demodulation, provided the bandpass filter in Fig. 
P7.7-3a is replaced by a lowpass (or baseband) filter. 


m(?) Bandpass k(t) cos «,t 
filter 3 —————_- 
+o, 


x(t) 
(a) 


(b) 


Figure P7.7-3 


7.7.4 Figure P7.7-4a shows a scheme to transmit two signals m,(t) and mo(t) simultaneously on the same 
channel (without causing spectral interference). Such a scheme, which transmits more than one signal, is 
known as signal multiplexing. In this case, we transmit multiple signals by sharing an available spectral 
band on the channel, and, hence, this is an example of the frequency-division multiplexing. The signal at 
point b is the multiplexed signal, which now modulates a carrier of frequency 20,000 rad/s. The 
modulated signal at point c is now transmitted over the channel. 


a. Sketch the spectra at points a, b, and c. 
b. What must be the minimum bandwidth of the channel? 


c. Design a receiver to recover signals m,(t) and mo(t) from the modulated signal at point c. 
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Figure P7.7-4 


7.7.5 The system shown in Fig. P7.7-5 is used for scrambling audio signals. The output y(t) is the scrambled 
version of the input m/(f). 


a. Find the spectrum of the scrambled signal y(t). 
b. Suggest a method of descrambling y(t) to obtain m(t). 


A slightly modified version of this scrambler was first used commercially on the 25-mile radio-telephone 
circuit connecting Los Angeles and Santa Catalina Island. 
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Figure P7.7-5 


7.7.6 Figure P7.7-6 presents a scheme for coherent (synchronous) demodulation. Show that this scheme can 
demodulate the AM signal [A + m(t)]cos wt regardless of the value of A. 


Output 


I -OWPAss de : 
filter block 


[A + an(t)] cos «,t 


cos «o,f 


Figure P7.7-6 


7.7.1 Sketch the AM signal [A + m(t)] cos Wet for the periodic triangle signal m(f) illustrated in Fig. P7.7-7 
corresponding to the following modulation indices: 


a. u=0.5 
b. u=1 
Cc. w=2 
d. U= 0 


How do you interpret the case U = 00? 
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Figure P7.7-7 
7.m.1 Consider the signal x(t) = e y(t). Modify MS7P2 to compute the following essential bandwidths. 


a. Setting a = 1, determine the essential bandwidth W, that contains 95% of the signal 
energy. Compare this value with the theoretical value presented in Example 7.20. 


b. Setting a = 2, determine the essential bandwidth W> that contains 90% of the signal 
energy. 


c. Setting a = 3, determine the essential bandwidth W3 that contains 75% of the signal 
energy. 
7.m.2 A unit amplitude pulse with duration T is defined as 
lt} <t/2 


x)= : 
0) otherwise 


a. Determine the duration T; that results in a 95% essential bandwidth of 5 Hz. 
b. Determine the duration T2 that results in a 90% essential bandwidth of 10 Hz. 


c. Determine the duration T3 that results in a 75% essential bandwidth 20 Hz. 


7.m.3 Consider the signal x(t) = e~ u(t). 


a. Determine the decay parameter a, that results in a 95% essential bandwidth of 5 Hz. 
b. Determine the decay parameter ao that results in a 90% essential bandwidth of 10 Hz. 


c. Determine the decay parameter a3 that results in a 75% essential bandwidth 20 Hz. 


7.m.4_— Use MATLAB to determine the 95, 90, and 75% essential bandwidths of a one-second triangle function 
with a peak amplitude of one. Recall that a triangle function can be constructed by the convolution of 
two rectangular pulses. 


7.m.5 A % duty-cycle square-pulse Tg-periodic signal x(t) is described as 


l —1)/6 <t < 1/6 
x(O = 0 To/t < \t| = Th/2 
x(t + Tp) Vt 


a. Use spectral sampling to determine the Fourier series coefficients Dy of x(t) for Tg = 2TT. 
Evaluate and plot D, for (0 < n < 10). 


b. Use spectral sampling to determine the Fourier series coefficients D, of x(t) for To = TT. 
Evaluate and plot D, for (0 < n < 10). How does this result compare with your answer to 
part a? What can be said about the relation of Tg to D, for signal x(t), which has fixed duty 
cycle of 1/3? 


7.m.6 Determine the Fourier transform of a Gaussian pulse defined as x(t) = et? Plot both x(t) and X(w). 


How do the two curves compare? [Hint: 


1 a 

~(p—a)*/? 
=| edt = 1 
ALD ‘Pixon 


for any real or imaginary a.] 


Chapter 8: Sampling-The Bridge From Continuous to Discrete 


OVERVIEW 


A continuous-time signal can be processed by processing its samples through a discrete-time system. For this purpose, it is important to 
maintain the signal sampling rate high enough to permit the reconstruction of the original signal from these samples without error (or 
with an error within a given tolerance). The necessary quantitative framework for this purpose is provided by the sampling theorem 
derived in Section 8.1. 


The sampling theory is the bridge between the continuous-time and the discrete-time worlds. The information inherent in a sampled 
continuous-time signal is equivalent to that of a discrete-time signal. A sampled continuous-time signal is a sequence of impulses, while 
a discrete-time signal presents the same information as a sequence of numbers. These are basically two different ways of presenting 
the same data. Clearly, all the concepts in the analysis of sampled signals apply to discrete-time signals. We should not be surprised to 
see that the Fourier spectra of the two kinds of signal are also the same (within a multiplicative constant). 


8.1 THE SAMPLING THEOREM 


We now show that a real signal whose spectrum is bandlimited to B Hz [X (w)= 0 for |w| > 27 B] can be reconstructed exactly (without 
any error) from its samples taken uniformly at a rate f , > 2B samples per second. In other words, the minimum sampling frequency is f 


s= 2B Hz.!t] 


LH LU = eee 
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Figure 8.1: Sampled signal and its Fourier spectrum. 


To prove the sampling theorem, consider a signal x (t) (Fig. 8.1a) whose spectrum is band-limited to B Hz (Fig. 8.1b).[4] For 
convenience, spectra are shown as functions of w as well as of f (hertz). Sampling x (t) at a rate of f , Hz (f s samples per second) can 
be accomplished by multiplying x (tf) by an impulse train 67 (t)(Fig. 8.1c), consisting of unit impulses repeating periodically every T 
seconds, where T= 1/f 5. The schematic of a sampler is shown in Fig. 8.1d. The resulting sampled signal x (f) is shown in Fig. 8.1e. 
The sampled signal consists of impulses spaced every T seconds (the sampling interval). The nth impulse, located at f= nT, has a 
strength x (nT), the value of x (f) at t= nT. 


X(t) = x(t)ér(t) = So x(nT s(t —nT) (8.1) 


Because the impulse train 67 (t) is a periodic signal of period T, it can be expressed as a trigonometric Fourier series like that already 
obtained in Example 6.7 [Eq. (6.39)] 


4 I 2x 
br(t) = Fl + 200s @,f + 2 COS 2a,f + 2 cos Few, f + - ++] a, = 7 = (8.2) 
Therefore 
1 
X(t) = x(t)4r(t) = oh + 2x(t) cos a@,f + 2x(1) cos 2,t + 2x(1) cos Fmt +--+] (8.3) 


To find X (w), the Fourier transform of x (t), we take the Fourier transform of the right-hand side of Eq. (8.3), term by term. The 


transform of the first term in the brackets is X (w). The transform of the second term 2x (f) cos Wet is X (W — Ws) + X (W + We) [See 
Eq. (7.41)]. This represents spectrum X (w) shifted to Ww, and —Wg. Similarly, the transform of the third term 2x (ft) cos 2Wef is X (Ww — 
2W5) + X (W + 2We), which represents the spectrum X (w) shifted to 2W. and —2Wg, and so on to infinity. This result means that the 
spectrum X (Ww) consists of X (Ww) repeating periodically with period W.= 2Tt/T rad/s, or f <= 1/T Hz, as depicted in Fig. 8.1f. There is 
also a constant multiplier 1/T in Eq. (8.3). Therefore 


— i & 
X(@) = = > X (w — no, ) (8.4) 


A=—- 


If we are to reconstruct x (ft) from x (tf), we should be able to recover X (w) from X (Ww). This recovery is possible if there is no overlap 
between successive cycles of X (Ww). Figure 8.1f indicates that this requires 


ES2a (8.5) 
Also, the sampling interval T= 1/f 5. Therefore 
T : 8.6 


Thus, as long as the sampling frequency f . is greater than twice the signal bandwidth B (in hertz), X (Ww) consists of nonoverlapping 
repetitions of X (Ww). Figure 8.1f shows that the gap between the two adjacent spectral repetitions is f , — 2B Hz, and x (t) can be 
recovered from its samples x (t) by passing the sampled signal x (ft) through an ideal lowpass filter having a bandwidth of any value 
between B and ?f, — B Hz. The minimum sampling rate f <= 2B required to recover x (ft) from its samples x (f) is called the Nyquist rate 
for x (t), and the corresponding sampling interval T= 1/2B is called the Nyquist interval for x (t). Samples of a signal taken at its Nyquist 
rate are the Nyquist samples of that signal. 


We are saying that the Nyquist rate 2B Hz is the minimum sampling rate required to preserve the information of x (f). This contradicts 
Eq. (8.5), where we showed that to preserve the information of x (tf), the sampling rate f , needs to be greater than 2B Hz. Strictly 
speaking, Eq. (8.5) is the correct statement. However, if the spectrum X (w) contains no impulse or its derivatives at the highest 
frequency B Hz, then the minimum sampling rate 2B Hz is adequate. In practice, it is rare to observe X (w) with an impulse or its 


derivatives at the highest frequency. If the contrary situation were to occur, we should use Eq. (8.5).[T] 


The sampling theorem proved here uses samples taken at uniform intervals. This condition is not necessary. Samples can be taken 
arbitrarily at any instants as long as the sampling instants are recorded and there are, on average, 2B samples per second.!] The 
essence of the sampling theorem was known to mathematicians for a long time in the form of the interpolation formula [see later, Eq. 
(8.11)]. The origin of the sampling theorem was attributed by H. S. Black to Cauchy in 1841. The essential idea of the sampling 
theorem was rediscovered in the 1920s by Carson, Nyquist, and Hartley. 


EXAMPLE 8.1 
In this example, we examine the effects of sampling a signal at the Nyquist rate, below the Nyquist rate (undersampling), and above the 


Nyquist rate (oversampling). Consider a signal x (t)= sin? (5trt) (Fig. 8.2a) whose spectrum is X (w)= 0.2 A (w/20TT) (Fig. 8.2b). The 
bandwidth of this signal is 5 Hz (101 rad/s). Consequently, the Nyquist rate is 10 Hz; that is, we must sample the signal at a rate no 
less than 10 samples/s. The Nyquist interval is T= 1/2B= 0.1 second. 


Figure 8.2: Effects of undersampling and oversampling. 


Recall that the sampled signal spectrum consists of (1/7) X (w) = (0.2/T) A (w/20Tr) repeating periodically with a period equal to the 
sampling frequency f , Hz. We present this information in Table 8.1 for three sampling rates: f <= 5 Hz (undersampling), 10 Hz (Nyquist 


rate), and 20 Hz (oversampling). 

Comments 
Undersampling 
Nyquist rate 
) Oversampling 


In the first case (undersampling), the sampling rate is 5 Hz (5 samples/s), and the spectrum (1/7) X (uw) repeats every 5 Hz (101 
rad/s). The successive spectra overlap, as depicted in Fig. 8.2d, and the spectrum X (w) is not recoverable from X (w); that is, x (tf) 
cannot be reconstructed from its samples x (f) in Fig. 8.2c. In the second case, we use the Nyquist sampling rate of 10 Hz (Fig. 8.2e). 
The spectrum X (Ww) consists of back-to-back, nonoverlapping repetitions of (1/7) X (w) repeating every 10 Hz. Hence, X (w) can be 
recovered from X (w) using an ideal lowpass filter of bandwidth 5 Hz (Fig. 8.2f). Finally, in the last case of oversampling (sampling rate 
20 Hz), the spectrum X (Ww) consists of nonoverlapping repetitions of (1/7) X (Ww) (repeating every 20 Hz) with empty bands between 
successive cycles (Fig. 8.2h). Hence, X (Ww) can be recovered from X (w) by using an ideal lowpass filter or even a practical lowpass 


filter (shown dashed in Fig. 8.2h).!T] 


Table 8.1 
= Open table as spreadsheet 


EXERCISE E8.1 


Find the Nyquist rate and the Nyquist interval for the signals sinc (1001r¢) and sinc (100Trf) + sinc (50tTrf). 9 


Answers 


The Nyquist interval is 0.01 second and the Nyquist sampling rate is 100 Hz for both the signals. 


FOR SKEPTICS ONLY 

Rare is a reader, who, at first encounter, is not skeptical of the sampling theorem. It seems impossible that Nyquist samples can define 
the one and the only signal that passes through those sample values. We can easily picture infinite number of signals passing through 
a given set of samples. However, among all these (infinite number of) signals, only one has the minimum bandwidth B < 1/2T Hz, 
where T is the sampling interval. See Prob. 8.2—9. 


To summarize, for a given set of samples taken at a rate of f , Hz, there is only one signal of bandwidth B < f ./2 that passes through 
those samples. All other signals that pass through those samples have bandwidth higher than f ,/2, and the samples are sub-Nyquist 
rate samples for those signals. 


8.1-1 Practical Sampling 


In proving the sampling theorem, we assumed ideal samples obtained by multiplying a signal x (f) by an impulse train that is physically 
unrealizable. In practice, we multiply a signal x (t) by a train of pulses of finite width, depicted in Fig. 8.3c. The sampler is shown in Fig. 
8.3d. The sampled signal x (f) is illustrated in Fig. 8.3e. We wonder whether it is possible to recover or reconstruct x (ft) from this x (f). 
Surprisingly, the answer is affirmative, provided the sampling rate is not below the Nyquist rate. The signal x (t) can be recovered by 
lowpass filtering x (f) as if it were sampled by impulse train. 
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Figure 8.3: Effect of practical sampling. 


The plausibility of this result becomes apparent when we consider the fact that reconstruction of x (f) requires the knowledge of the 
Nyquist sample values. This information is available or built in the sampled signal x (ft) in Fig. 8.3e because the nth sampled pulse 
strength is x (nT). To prove the result analytically, we observe that the sampling pulse train p 7 (t) depicted in Fig. 8.3c, being a 
periodic signal, can be expressed as a trigonometric Fourier series 


: 2n 
Prit) =Co+ D> C, 008 (nwt +%) = = 

n=1 
and 

¥() = x(t) pr(t) =x) | Co + > G COS (Nw, + Op) 
a=l 
ra 
= Cox(t) + >= C.x(1) cos (n@,t + 6,) (8.7) 


The sampled signal x (ft) consists of Cox (t), C1x (t) cos (Wet + 81), Co x (t) cos(2w, t 89),.... Note that the first term Cox (t) is the 
desired signal and all the other terms are modulated signals with spectra centered at tW,, tW5, tWe, ..., aS illustrated in Fig. 8.3f. 
Clearly the signal x (f) can be recovered by lowpass filtering of x (t), as shown in Fig. 8.3d. As before, it is necessary that w, > 41 B 


(orf, > 2B). 


EXAMPLE 8.2 

To demonstrate practical sampling, consider a signal x (f)= sinc? (51rt) sampled by a rectangular pulse sequence p 7 (f) illustrated in 
Fig. 8.4c. The period of p 7 (t) is 0.1 second, so that the fundamental frequency (which is the sampling frequency) is 10 Hz. Hence, 
W.= 20TT. 


The Fourier series for p 7 (ft) can be expressed as 


wo 
Pr(t) = Cot+ ‘a C, COSNOsf 


n=! 


» 5 5 fie 
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Figure 8.4: An example of practical sampling. 
Hence 
F(t) = x() prt) 
= Cyx(t) + Cix(t) cos 2021 + Cox (1) cos 4021 + Cax(t) cos 601 +--+ 


a | — 2 sin (™ 
Use of Eqs. (6.18) yields Co — 4 and C, = ay SIN ( 4 I csneqiantiy we have 
¥(t) = x(t)prit) 


= 4x(t) + C.x(t) cos 2021 + Cpx(1) cos 4021 + Cyx(1) cos 60m 1 + ++ 


and 


1 S Cp 
X(w) = q*@) > SIX (w — 207) + X(@ + 207 )] + =[X(@ — 407) 


C 
+ X(w@ + 407)] + =[X(w — 60x) + X(w + 60r))} +>: 


where C ,= (2/ntr) sin (n11/4). The spectrum consists of X (w) repeating periodically at the interval of 201 rad/s (10 Hz). Hence, there 
is no overlap between cycles, and X (w) can be recovered by using an ideal lowpass filter of bandwidth 5 Hz. An ideal lowpass filter of 
unit gain (and bandwidth 5 Hz) will allow the first term on the right hand side of the foregoing equation to pass fully and suppress all the 
other terms. Hence, the output y (f) is 


y(t) = 4x(n) 


EXERCISE E8.2 
Show that the basic pulse p (ft) used in the sampling pulse train in Fig. 8.4c cannot have zero area if we wish to reconstruct x (ft) by 
lowpass-filtering the sampled signal. 


[t]The theorem stated here (and proved subsequently) applies to lowpass signals. A bandpass signal whose spectrum exists over a 
frequency band f , — (B/2) < |f| < f, + (B/2) has a bandwidth of B Hz. Such a signal is uniquely determined by 2B samples per 
second. In general, the sampling scheme is a bit more complex in this case. It uses two interlaced sampling trains, each at a rate of B 


samples per second. See, for example, Linden.!"] 


[tlLinden, D. A. A discussion of sampling theorem. Proceedings of the IRE, vol. 47, pp. 1219-1226, July 1959. 
[*]The spectrum X (w) in Fig. 8.1b is shown as real, for convenience. However, our arguments are valid for complex X (WwW) as well. 


[Tan interesting observation is that if the impulse is because of a cosine term, the sampling rate of 2B Hz is adequate. However, if the 
impulse is because of a sine term, then the rate must be greater than 2B Hz. This may be seen from the fact that samples of sin 2T Bt 


using T= 1/2B are all zero because sin 21 BnT= sin trn= 0. But, samples of cos 211 Bt are cos 21 BnT= cos Trn= (—1)”. We can 
reconstruct cos 21 Bt from these samples. This peculiar behavior occurs because in the sampled signal spectrum corresponding to the 
signal cos 2Tt Bt, the impulses, which occur at frequencies (2n+1) B Hz (n= 0, +1, +2, ...), interact constructively, whereas in the case 
of sin 2TrBt, the impulses, because of their opposite phases (ehm2, interact destructively and cancel out in the sampled signal 
spectrum. Hence, sin 2T Bt cannot be reconstructed from its samples at a rate of 2B Hz. A similar situation exists for signal cos(2Tr Bt 
+ 8), which contains a component of the form sin 21 Bt. For this reason, it is advisable to maintain sampling rate above 2B Hz if a 
finite amplitude component of a sinusoid of frequency B Hz is present in the signal. 


[2]Siebert, W. M. Circuits, Signals, and Systems. MIT-McGraw-Hill, New York, 1986. 


[t]The filter should have a constant gain between 0 and 5 Hz and zero gain beyond 10 Hz. In practice, the gain beyond 10 Hz can be 
made negligibly small, but not zero. 


8.2 SIGNAL RECONSTRUCTION 


The process of reconstructing a continuous-time signal x (t) from its samples is also known as interpolation. In Section 8.1, we saw that 
a signal x (t) bandlimited to B Hz can be reconstructed (interpolated) exactly from its samples if the sampling frequency f , exceeds 2B 
Hz or the sampling interval Tis less than 1/2B. This reconstruction is accomplished by passing the sampled signal through an ideal 
lowpass filter of gain T and having a bandwidth of any value between B and f , — B Hz. From a practical viewpoint, a good choice is 
the middle value f ./2= 1/2T Hz or tt/T rad/s. This value allows for small deviations in the ideal filter characteristics on either side of the 
cutoff frequency. With this choice of cutoff frequency and gain 7, the ideal lowpass filter required for signal reconstruction (or 
interpolation) is 


oT 


i 
H(a) == 7 rect (=) =: T rect (=) (8.8) 


The interpolation process here is expressed in the frequency domain as a filtering operation. Now we shall examine this process from 
the time-domain viewpoint. 


TIME-DOMAIN VIEW: A SIMPLE INTERPOLATION 


Consider the interpolation system shown in Fig. 8.5a. We start with a very simple interpolating filter, whose impulse response is rect 
(t/T), depicted in Fig. 8.55. This is a gate pulse centered at the origin, having unit height, and width T (the sampling interval). We shall 
find the output of this filter when the input is the sampled signal x (t) consisting of an impulse train with the nth impulse at f= nT with 
strength x (nT). Each sample in x (ft), being an impulse, produces at the output a gate pulse of height equal to the strength of the 
sample. For instance, the nth sample is an impulse of strength x (nT) located at t= nT and can be expressed as x (n7T)8(t — nT). When 
this impulse passes through the filter, it produces at the output a gate pulse of height x (nT), centered at f= nT (shaded in Fig. 8.5c). 
Each sample in x (f) will generate a corresponding gate pulse, resulting in the filter output that is a staircase approximation of x (t), 
shown dotted in Fig. 8.5c. This filter thus gives a crude form of interpolation. 
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Figure 8.5: Simple interpolation by means of a zero-order hold (ZOH) circuit. (a) ZOH interpolator. (b) Impulse response of a ZOH 
circuit. (c) Signal reconstruction by ZOH, as viewed in the time domain. (d) Frequency response of a ZOH. 


The frequency response of this filter H (Ww) is the Fourier transform of the impulse response rect (¢/T). 


t 
A(t) = rect (=) (8.9a) 


and 
ney wT 
H(@) = Tsine (+) (8.9b) 


The amplitude response |H (w)| for this filter, illustrated in Fig. 8.5d, explains the reason for the crudeness of this interpolation. This 
filter, also known as the zero-order hold (ZOH) filter, is a poor form of the ideal lowpass filter (shaded in Fig. 8.5d) required for exact 


interpolation. [1] 


We can improve on the ZOH filter by using the first-order hold filter, which results in a linear interpolation instead of the staircase 
interpolation. The linear interpolator, whose impulse response is a triangle pulse A(t/27T), results in an interpolation in which successive 
sample tops are connected by straight-line segments (see Prob. 8.2-3). 


TIME-DOMAIN VIEW: AN IDEAL INTERPOLATION 


The ideal interpolation filter frequency response obtained in Eq. (8.8) is illustrated in Fig. 8.6a. The impulse response of this filter, the 
inverse Fourier transform of H (Ww) is 
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Figure 8.6: Ideal interpolation for Nyquist sampling rate. 


t 
A(t) = sine (=) (8.10a) 


For the Nyquist sampling rate, T= 1/2B, and 
h(t) = sine (27 Bt) (8.10b) 


This h (t) is depicted in Fig. 8.6b. Observe the interesting fact that h (t)= 0 at all Nyquist sampling instants (f= +n/2B) except at f= 0. 
When the sampled signal x (t) is applied at the input of this filter, the output is x (t). Each sample in x (tf), being an impulse, generates 
a sinc pulse of height equal to the strength of the sample, as illustrated in Fig. 8.6c. The process is identical to that depicted in Fig. 
8.5c, except that h (ft) is a sinc pulse instead of a gate pulse. Addition of the sinc pulses generated by all the samples results in x (f). 
The nth sample of the input x (t) is the impulse x (n7T)8(t—n7T); the filter output of this impulse is x (nT)h (t—nT). Hence, the filter 
output to x (tf), which is x (¢), can now be expressed as a sum 


sO = So x(nT hts —nT) 
= >> x(n) sine Ex - nt) (8.1 la) 


For the case of Nyquist sampling rate, T= 1/2B, and Eq. (8.11a) simplifies to 


x(t) = $° x(n) sine (27 Bt — nz) (8.11b) 


Equation (8.11b) is the interpolation formula, which yields values of x (tf) between samples as a weighted sum of all the sample values. 


EXAMPLE 8.3 
Find a signal x (t) that is bandlimited to B Hz, and whose samples are 


x(0)=1 and x(£7) = x(42T) = x(43T7) =---=0 
where the sampling interval T is the Nyquist interval for x (tf), that is, T= 1/2B. 


Because, we are given the Nyquist sample values, we use the interpolation formula (8.11b) to construct x (tf) from its samples. Since all 
but one of the Nyquist samples are zero, only one term (corresponding to n= 0) in the summation on the right-hand side of Eq. (8.11b) 
survives. Thus 


x(t) = sinc (27 Bt) (8.12) 


This signal is illustrated in Fig. 8.6b. Observe that this is the only signal that has a bandwidth B Hz and the sample values x (0)= 1 and 
X (nT)= 0 (n + 0). No other signal satisfies these conditions. 


8.2-1 Practical Difficulties in Signal Reconstruction 


Consider the signal reconstruction procedure illustrated in Fig. 8.7a. If x (f) is sampled at the Nyquist rate f == 2B Hz, the spectrum X 
(w) consists of repetitions of X (w) without any gap between successive cycles, as depicted in Fig. 8.7b. To recover x (ft) from x (t), we 
need to pass the sampled signal x (t) through an ideal lowpass filter, shown dotted in Fig. 8.7b. As seen in Section 7.5, such a filter is 
unrealizable; it can be closely approximated only with infinite time delay in the response. In other words, we can recover the signal x (f) 
from its samples with infinite time delay. A practical solution to this problem is to sample the signal at a rate higher than the Nyquist rate 
(f 5 >2B or We > 471B). The result is X (Ww), consisting of repetitions of X (w) with a finite band gap between successive cycles, as 
illustrated in Fig. 8.7c. Now, we can recover X (Ww) from X (Ww) using a lowpass filter with a gradual cutoff characteristic, shown dotted 
in Fig. 8.7c. But even in this case, if the unwanted spectrum is to be suppressed, the filter gain must be zero beyond some frequency 
(see Fig. 8.7c). According to the Paley-Wiener criterion [Eq. (7.61)], it is impossible to realize even this filter. The only advantage in this 
case is that the required filter can be closely approximated with a smaller time delay. All this means that it is impossible in practice to 
recover a bandlimited signal x (t) exactly from its samples, even if the sampling rate is higher than the Nyquist rate. However, as the 
sampling rate increases, the recovered signal approaches the desired signal more closely. 
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Figure 8.7: (a) Signal reconstruction from its samples. (b) Spectrum of a signal sampled at the Nyquist rate. (c) Spectrum of a 
signal sampled above the Nyquist rate. 


THE TREACHERY OF ALIASING 

There is another fundamental practical difficulty in reconstructing a signal from its samples. The sampling theorem was proved on the 
assumption that the signal x (t) is bandlimited. All practical signals are timelimited; that is, they are of finite duration or width. We can 
demonstrate (see Prob. 8.2-14) that a signal cannot be timelimited and bandlimited simultaneously. If a signal is timelimited, it cannot 
be bandlimited, and vice versa (but it can be simultaneously nontimelimited and nonbandlimited). Clearly, all practical signals, which are 
necessarily timelimited, are nonbandlimited, as shown in Fig. 8.8a; they have infinite bandwidth, and the spectrum X (w) consists of 
overlapping cycles of X (Ww) repeating every f , Hz (the sampling frequency), as illustrated in Fig. 8.8b.!T] Because of infinite bandwidth 
in this case, the spectral overlap is unavoidable, regardless of the sampling rate. Sampling at a higher rate reduces but does not 
eliminate overlapping between repeating spectral cycles. Because of the overlapping tails, X (Ww) no longer has complete information 
about X (Ww), and it is no longer possible, even theoretically, to recover x (ft) exactly from the sampled signal x (f). If the sampled signal 
is passed through an ideal lowpass filter of cutoff frequency f ./2 Hz, the output is not X (w) but X , (W) (Fig. 8.8c), which is a version 
of X (w) distorted as a result of two separate causes: 
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Figure 8.8: Aliasing effect. (a) Spectrum of a practical signal x (ft). (b) Spectrum of sampled x (t). (¢) Reconstructed signal 
spectrum. (d) Sampling scheme using antialiasing filter. (e) Sampled signal spectrum (dotted) and the reconstructed signal 
spectrum (solid) when antialiasing filter is used. 


1. The loss of the tail of X (Ww) beyond |f] > f ./2 Hz. 


2. The reappearance of this tail inverted or folded onto the spectrum. Note that the spectra cross at frequency f ,/2= 1/2T 
Hz. This frequency is called the folding frequency. The spectrum may be viewed as if the lost tail is folding back onto itself 
at the folding frequency. For instance, a component of frequency (f ./2) + f , shows up as or "impersonates" as a 
component of lower frequency (f ,/2) — fz in the reconstructed signal. Thus, the components of frequencies above f ,/2 
reappear as components of frequencies below f ./2. This tail inversion, known as spectral folding or aliasing, is shown 
shaded in Fig. 8.8b and also in Fig. 8.8c. In the process of aliasing, not only are we losing all the components of 
frequencies above the folding frequency f ./2 Hz, but these very components reappear (aliased) as lower-frequency 
components, as shown in Fig. 8.8b or 8.8c. Such aliasing destroys the integrity of the frequency components below the 
folding frequency f ./2, as depicted in Fig. 8.8c. 


The aliasing problem is analogous to that of an army with a platoon that has secretly defected to the enemy side. The platoon is, 
however, ostensibly loyal to the army. The army is in double jeopardy. First, the army has lost this platoon as a fighting force. In 
addition, during actual fighting, the army will have to contend with the sabotage by the defectors and will have to find another loyal 
platoon to neutralize the defectors. Thus, the army has lost two platoons in nonproductive activity. 


DEFECTORS ELIMINATED: THE ANTIALIASING FILTER 

If you were the commander of the betrayed army, the solution to the problem would be obvious. As soon as the commander got wind of 
the defection, he would incapacitate, by whatever means, the defecting platoon before the fighting begins. This way he loses only one 
(the defecting) platoon. This is a partial solution to the double jeopardy of betrayal and sabotage, a solution that partly rectifies the 
problem and cuts the losses to half. 


We follow exactly the same procedure. The potential defectors are all the frequency components beyond the folding frequency f ./2= 
1/2T Hz. We should eliminate (suppress) these components from x (t) before sampling x (t). Such suppression of higher frequencies 
can be accomplished by an ideal lowpass filter of cutoff f ./2 Hz, as shown in Fig. 8.8d. This is called the antialiasing filter. Figure 8.8d 


also shows that antialiasing filtering is performed before sampling. Figure 8.8e shows the sampled signal spectrum (dotted) and the 
reconstructed signal X a, (Ww) when antialiasing scheme is used. An antialiasing filter essentially bandlimits the signal x (f) to f ./2 Hz. 


This way, we lose only the components beyond the folding frequency f ;/2 Hz. These suppressed components now cannot reappear to 
corrupt the components of frequencies below the folding frequency. Clearly, use of an antialiasing filter results in the reconstructed 
signal spectrum X a, (w)= X (w) for |f| < f ./2. Thus, although we lost the spectrum beyond f ./2 Hz, the spectrum for all the 


frequencies below f ,/2 remains intact. The effective aliasing distortion is cut in half owing to elimination of folding. We stress again that 
the antialiasing operation must be performed before the signal is sampled. 


An antialiasing filter also helps to reduce noise. Noise, generally, has a wideband spectrum, and without antialiasing, the aliasing 
phenomenon itself will cause the noise lying outside the desired band to appear in the signal band. Antialiasing suppresses the entire 
noise spectrum beyond frequency f ,/2. 


The antialiasing filter, being an ideal filter, is unrealizable. In practice, we use a steep cutoff filter, which leaves a sharply attenuated 
spectrum beyond the folding frequency f ,/2. 


SAMPLING FORCES NONBANDLIMITED SIGNALS TO APPEAR BANDLIMITED 

Figure 8.8b shows the spectrum of a signal x (ft) consists of overlapping cycles of X (w). This means that x (f) are sub-Nyquist samples 
of x (t). However, we may also view the spectrum in Fig. 8.8b as the spectrum X , (w) (Fig. 8.8c), repeating periodically every f , Hz 
without overlap. The spectrum X , (W) is bandlimited to f sw Hz. Hence, these (sub-Nyquist) samples of x (ft) are actually the Nyquist 
samples for signal x , (f). In conclusion, sampling a nonbandlimited signal x (t) at a rate f s Hz makes the samples appear to be the 
Nyquist samples of some signal x , (f), bandlimited to f , Hz. In other words, sampling makes a nonbandlimited signal appear to be a 
bandlimited signal x , (t) with bandwidth f ./2 Hz. A similar conclusion applies if x (t) is bandlimited but sampled at a sub-Nyquist rate. 


VERIFICATION OF ALIASING IN SINUSOIDS 

We showed in Fig. 8.8b how sampling a signal below the Nyquist rate causes aliasing, which makes a signal of higher frequency (f ./2) 
+ f , Hz masquerade as a signal of lower frequency (f s/2) — f , Hz. Figure 8.8b demonstrates this result in the frequency domain. Let 
us now verify it in the time domain to gain a deeper appreciation of aliasing. 


We can prove our proposition by showing that samples of sinusoids of frequencies (w,/2) + wz and (W,/2 — wz are identical when the 
sampling frequency is f .= W./2Tt Hz. 


For a sinusoid x (t)= cos wt, sampled at intervals of T seconds, x (nT), its nth sample (at f= nT) is 
x(nT) = cos @nT n integer 


Hence, samples of sinusoids of frequency w= (W,/2) + Wz arelT] 


x(nT) = cos (F +0,)nr (8.13) 


= COS ($+) ar cosanr F sin (S)ar sinw.nT 
Recognizing that w,7= 21 f ,T= 271, and sin (W./2)nT= sin trn= 0 for all integer n, we obtain 


(). 
x(nT) = cos (> nT cos@,nT 


ne 


Clearly, the samples of a sinusoid of frequency (f ./2) + f , are identical to the samples of a sinusoid (f ./2) — f 7.4] For instance, when 
a sinusoid of frequency 100 Hz is sampled at a rate of 120 Hz, the apparent frequency of the sinusoid that results from reconstruction 
of the samples is 20 Hz. This follows from the fact that here, 100= (f ./2) + f = 60 + f, so that f = 40. Hence, (f ,/2) — f z= 20. Such 
would precisely be the conclusion arrived at from Fig. 8.8b. 


This discussion again shows that sampling a sinusoid of frequency f aliasing can be avoided if the sampling rate f , > 2f Hz. 


0<f < = or 0< < il (8.14) 


Violating this condition leads to aliasing, implying that the samples appear to be those of a lower-frequency signal. Because of this loss 
of identity, it is impossible to reconstruct the signal faithfully from its samples. 


GENERAL CONDITION FOR ALIASING IN SINUSOIDS 
We can generalize the foregoing result by showing that samples of a sinusoid of frequency f 9 are identical to those of a sinusoid of 


frequency f 9 + mf , Hz (integer m), where f , is the sampling frequency. The samples of cos 2Tt (f 9 + mf ,) t are 
cos 2 (fo + mf,)nT = cos (22 fonT + 22mn) = cos 27 fonT 


The result follows because mn is an integer and f .T= 1. This result shows that sinusoids of frequencies that differ by integer multiple of 
f , result in identical set of samples. In other words, samples of sinusoids separated by frequency f . Hz are identical. This implies that 
samples of sinusoids in any frequency band of f , Hz are unique; that is, no two sinusoids in that band have the same samples (when 


sampled at a rate f , Hz). For instance, frequencies in the band from — f ,/2 to f ./2 have unique samples (at the sampling rate f <). 
This band is called the fundamental band. Recall also that f ,/2 is the folding frequency. 


From the discussion thus far, we conclude that if a continuous-time sinusoid of frequency f Hz is sampled ata rate of f , Hz 
(samples/s), the resulting samples would appear as samples of a continuous-time sinusoid of frequency f , in the fundamental band, 
where 

fa=f—mf, - f <3f,.< £ m an integer (8.15a) 


The frequency f g lies in the fundamental band from — f ,/2 to f ./2. Figure 8.9a shows the plot of f , versus f, where fis the actual 
frequency and f , is the corresponding fundamental band frequency, whose samples are identical to those of the sinusoid of frequency 
f, when sampling rate is f , Hz. 
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Figure 8.9: Apparent frequencies of a sampled sinusoid: (a) f , versus f and (b) |f ,| versus f. 


Recall, however, that the sign change of a frequency does not alter the actual frequency of the waveform. This is because 
cos(—@,f + 6) = cos (@,t — 0) 

Clearly the apparent frequency of a sinusoid of frequency — f , is also f ,. However, its phase undergoes a sign change. This means 
the apparent frequency of any sampled sinusoid lies in the range from 0 to f ./2 Hz. To summarize, if a continuous-time sinusoid of 
frequency f Hz is sampled at a rate of f , Hz (samples/second), the resulting samples would appear as samples of a continuous-time 
sinusoid of frequency |f g| that lies in the band from 0 to f ./2. According to Eq. (8.15a) 


lfal=lf —mf,| |\fal = £ m an integer (8.15b) 


The plot of the apparent frequency |f ,| versus f is shown in Fig. 8.9b.[T] As expected, the apparent frequency |f ,| of any sampled 
sinusoid, regardless of its frequency, is always in the range of 0 to f ,/2 Hz. However, when f , is negative, the phase of the apparent 
sinusoid undergoes a sign change. The frequency belts in which such phase changes occur are shown shaded in Fig. 8.9b. 


Consider, for example, a sinusoid cos (211 ft + 8) with f 8000 Hz sampled at a rate f <= 3000 Hz. Using Eq. (8.15a), we obtain f 4= 
8000 — 3 x 3000= —1000. Hence, |f ,|= 1000. The samples would appear to have come from a sinusoid cos (2000w t w @). Observe 
the sign change of the phase because f q is negative [+1 


In the light of the foregoing development, let us consider a sinusoid of frequency f = (f ./2) + fz, sampled at a rate of f , Hz. According 
to Eq. (8.15a). 
fs 


_ Ss C 
fe= Ft h-(x f)=—-F +h 


Hence, the apparent frequency is |f ,|= (f ./2) — f 7, confirming our earlier result. However, the phase of the sinusoid will suffer a sign 
change because f q is negative. 


Figure 8.10 shows how samples of sinusoids of two different frequencies (sampled at the same rate) generate identical sets of samples. 
Both the sinusoids are sampled at a rate f == 5 Hz (T= 0.2 second). The frequencies of the two sinusoids, 1 Hz (period 1) and 6 Hz 
(period 1/6), differ by f == 5 Hz. 


Figure 8.10: Demonstration of aliasing. 


The reason for aliasing can be clearly seen in Fig. 8.10. The root of the problem is the sampling rate, which may be adequate for the 
lower-frequency sinusoid but is clearly inadequate for the higher-frequency sinusoid. The figure clearly shows that between the 
successive samples of the higher-frequency sinusoid, there are wiggles, which are bypassed or ignored, and are unrepresented in the 
samples, indicating a sub-Nyquist rate of sampling. The frequency of the apparent signal X , (f) is always the lowest possible frequency 
that lies within the band |f] < f ,/2. Thus, the apparent frequency of the samples in this example is 1 Hz. If these samples are chosen 
to reconstruct a signal using a lowpass filter of bandwidth f ,/2, we shall obtain a sinusoid of frequency 1 Hz. 


EXAMPLE 8.4 


A continuous-time sinusoid cos (21 ft + 8) is sampled at a rate f == 1000 Hz. Determine the apparent (aliased) sinusoid of the resulting 
samples if the input signal frequency f is: 


a. 400 Hz 
b. 600 Hz 
c. 1000 Hz 
d. 2400 Hz 


The folding frequency is f ,/2 = 500. Hence, sinusoids below 500 Hz (frequency within the fundamental band) will not be aliased and 
sinusoids of frequency above 500 Hz will be aliased. 


a. f 400 Hz is less than 500 Hz, and there is no aliasing. The apparent sinusoid is cos (211 ft + 8) with f= 400. 


b. f= 600 Hz can be expressed as 600= —400 + 1000 so that f .= —400. Hence, the aliased frequency is 400 Hz and the 
phase changes sign. Hence, the apparent (aliased) sinusoid is cos (2Tr ft — 8) with f 400. 


c. f 1000 Hz can be expressed as 1000= 0 + 1000 so that f ,= 0. Hence, the aliased frequency is 0 Hz (dc), and there is no 


phase sign change. Hence, the apparent sinusoid is y (f)= cos (OTtt + 8)= cos (8). This is a dc signal with constant 
sample values for all n. 


d. f 2400 Hz can be expressed as 2400= 400 + (2 x 1000) so that f = 400. Hence, the aliased frequency is 400 Hz and 
there is no sign change for the phase. The apparent sinusoid is cos (2Tr ft + 8) with f= 400. 


We could have found these answers directly from Fig. 8.96. For example, for case b, we read |f ,|= 400 corresponding to f= 600. 
Moreover, f= 600 lies in the shaded belt. Hence, there is a phase sign change. 


EXERCISE E8.3 
Show that samples of 90 Hz and 110 Hz sinusoids of the form cos wt are identical when sampled at a rate 200 Hz. 


EXERCISE E8.4 


A sinusoid of frequency f 9 Hz is sampled at a rate of 100 Hz. Determine the apparent frequency of the 9 
samples if f 9 is 7 
a. 40 Hz 
b. 60 Hz 
c. 140 Hz 
d. 160 Hz 
Answers 


40 Hz for all four cases 


8.2-2 Some Applications of the Sampling Theorem 


The sampling theorem is very important in signal analysis, processing, and transmission because it allows us to replace a continuous- 
time signal with a discrete sequence of numbers. Processing a continuous-time signal is therefore equivalent to processing a discrete 
sequence of numbers. Such processing leads us directly into the area of digital filtering. In the field of communication, the transmission 
of a continuous-time message reduces to the transmission of a sequence of numbers by means of pulse trains. The continuous-time 
signal x (t) is sampled, and sample values are used to modify certain parameters of a periodic pulse train. We may vary the amplitudes 
(Fig. 8.11b), widths (Fig. 8.11c), or positions (Fig. 8.11d) of the pulses in proportion to the sample values of the signal x (f). Accordingly, 
we may have pulse-amplitude modulation (PAM), pulse-width modulation (PWM), or pulse-position modulation (PPM) The most 
important form of pulse modulation today is pulse-code modulation (PCM), discussed in Section 8.3 in connection with Fig. 8.14b. In all 
these cases, instead of transmitting x (t), we transmit the corresponding pulse-modulated signal. At the receiver, we read the 
information of the pulse-modulated signal. At the receiver, we read the information of the pulse-modulated signal and reconstruct the 
analog signal x (¢). 
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Figure 8.11: Pulse-modulated signals. (a) The signal. (b) The PAM signal. (c) The PWM (PDM) signal. (d) The PAM 
signal. 


One advantage of using pulse modulation is that it permits the simultaneous transmission of several signals on a time-sharing 
basis-time-division multiplexing (TDM). Because a pulse-modulated signal occupies only a part of the channel time, we can transmit 
several pulse-modulated signals on the same channel by interweaving them. Figure 8.12 shows the TDM of two PAM signals. In this 


manner, we can multiplex several signals on the same channel by reducing pulse widths. [T] 
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Figure 8.12: Time-division multiplexing of two signals. 


Digital signals also offer an advantage in the area of communications, where signals must travel over distances. Transmission of digital 
signals is more rugged than that of analog signals because digital signals can withstand channel noise and distortion much better as 
long as the noise and the distortion are within limits. An analog signal can be converted to digital binary form through sampling and 
quantization (rounding off), as explained in the next section. The digital (binary) message in Fig. 8.13a is distorted by the channel, as 
illustrated in Fig. 8.13b. Yet if the distortion remains within a limit, we can recover the data without error because we need only make a 
simple binary decision: Is the received pulse positive or negative? Figure 8.13c shows the same data with channel distortion and noise. 


Here again the data can be recovered correctly as long as the distortion and the noise are within limits. Such is not the case with 
analog messages. Any distortion or noise, no matter how small, will distort the received signal. 
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Figure 8.13: Digital signal transmission: (a) at the transmitter, (b) received distorted signal (without noise), (c) received distorted 
signal (with noise), and (d) regenerated signal at the receiver. 


The greatest advantage of digital communication over the analog counterpart, however, is the viability of regenerative repeaters in the 
former. In an analog transmission system, a message signal grows progressively weaker as it travels along the channel (transmission 
path), whereas the channel noise and the signal distortion, being cumulative, become progressively stronger. Ultimately the signal, 
overwhelmed by noise and distortion, is mutilated. Amplification is of little help because it enhances the signal and the noise in the 
same proportion. Consequently, the distance over which an analog message can be transmitted is limited by the transmitted power. If a 
transmission path is long enough, the channel distortion and noise will accumulate sufficiently to overwhelm even a digital signal. The 
trick is to set up repeaters along the transmission path at distances short enough to permit detection of signal pulses before the noise 
and distortion have a chance to accumulate sufficiently. At each repeater, the pulses are detected, and new, clean pulses are 
transmitted to the next repeater, which, in turn, duplicates the same process. If the noise and distortion remain within limits (which is 


possible because of the closely spaced repeaters), pulses can be detected correctly.T] This way the digital messages can be 
transmitted over longer distances with greater reliability. In contrast, analog messages cannot be cleaned up periodically, and their 
transmission is therefore less reliable. The most significant error in digitized signals comes from quantizing (rounding off). This error, 
discussed in Section 8.3, can be reduced as much as desired by increasing the number of quantization levels, at the cost of an 
increased bandwidth of the transmission medium (channel). 


[tlFigure 8.5b shows that the impulse response of this filter is noncausal, and this filter is not realizable. In practice, we make it 
realizable by delaying the impulse response by 7/2. This merely delays the output of the filter by 7/2. 


[t]lFigure 8.8b shows that from the infinite number of repeating cycles, only the neighboring spectral cycles overlap. This is a somewhat 
simplified picture. In reality, all the cycles overlap and interact with every other cycle because of the infinite width of all practical signal 
spectra. Fortunately, all practical spectra also must decay at higher frequencies. This results in insignificant amount of interference from 
cycles other than the immediate neighbors. When such an assumption is not justified, aliasing computations become little more 
involved. 


[TlHere we have ignored the phase aspect of the sinusoid. Sampled versions of a sinusoid x (t)= cos (wt + 8) with two different 
frequencies (W,/2) wz have identical frequency, but the phase signs may be reversed depending on the value of wz. 


[*]The reader is encouraged to verify this result graphically by plotting the spectrum of a sinusoid of frequency (W,/2) + Wz, (impulses 
at + [W,/2) +Wz] and its periodic repetition at intervals we,. Although the result is valid for all values of wz, consider the case of wz 
<w,/2 to simplify the graphics. 


[tlThe plots in Figs. 8.9 and Fig. 5.16 are identical. This is because a sampled sinusoid is basically a discrete-time sinusoid. 


[t]For phase sign change, we are assuming the signal of the form cos (2tt ft + 8). If the form is sin (211 ft + @), the rule changes 
slightly. It is left as an exercise for the reader to show that when f , < 0, this sinusoid appears as —sin (2tt|f ,|t—8). Thus, in addition 
to phase change, the amplitude also changes sign. 


[t]Another method of transmitting several beaseband signals simultaneously is frequency-division multiplexing (FDM) discussed in 
Section 7.7-4. In FDM various signals are multiplexed by sharing the channel bandwidth. The spectrum of each message is shifted to a 
specific band not occupied by any other signal. The information of various signals is located in nonoverlapping frequency bands of the 
channel (Fig. 7.44). In a way. TDM and FDM are duals of each other. 


[t]The error in pulse detection can be made negligible. 


8.3 ANALOG-TO-DIGITAL (A/D) CONVERSION 


An analog signal is characterized by the fact that its amplitude can take on any value over a continuous range. Hence, analog signal 
amplitude can take on an infinite number of values. In contrast, a digital signal amplitude can take on only a finite number of values. An 
analog signal can be converted into a digital signal by means of sampling and quantizing (rounding off). Sampling and analog signal 
alone will not yield a digital signal because a sample of analog signal can still take on any value in a continuous range. It is digitized by 
rounding off its value to one of the closest permissible numbers (or quantized levels), as illustrated in Fig. 8.14a, which represents one 
possible quantizing scheme. The amplitudes of the analog signal x (f) lie in the range (—V, V). This range is partitioned into L 
subintervals, each of magnitude A= 2V/L. Next, each sample amplitude is approximated by the midpoint value of the subinterval in 
which the sample falls (see Fig. 8.14a for L= 16). It is clear that each sample is approximated to one of the L numbers. Thus, the signal 
is digitized with quantized samples taking on any one of the L values. This is an L-ary digital signal (see Section 1.3-2). Each sample 
can now be represented by one of L distinct pulses. 
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Figure 8.14: Analog-to-digital (A/D) conversion of a signal: (a) quantizing and (b) pulse coding. 


From a practical viewpoint, dealing with a large number of distinct pulses is difficult. We prefer to use the smallest possible number of 
distinct pulses, the very smallest number being two. A digital signal using only two symbols or values is the binary signal. A binary 
digital signal (a signal that can take on only two values) is very desirable because of its simplicity, economy, and ease of engineering. 
We can convert an L-ary signal into a binary signal by using pulse coding. Figure 8.14b shows one such code for the case of L= 16. 
This code, formed by binary representation of the 16 decimal digits from 0 to 15, is known as the natural binary code (NBC). For L 


quantization levels, we need a minimum of b binary code digits, where 2°> or b= logg L. 


Each of the 16 levels is assigned one binary code word of four digits. Thus, each sample in this example is encoded by four binary 
digits. To transmit or digitally process the binary data, we need to assign a distinct electrical pulse to each of the two binary states. One 
possible way is to assign a negative pulse to a binary 0 and a positive pulse to a binary 1 so that each sample is now represented by a 
group of four binary pulses (pulse code), as depicted in Fig. 8.14b. The resulting binary signal is a digital signal obtained from the 
analog signal x (t) through A/D conversion. In communications jargon, such a signal is known as a pulse-code-modulated (PCM) signal. 


The convenient contraction of "binary digit" to bit has become an industry standard abbreviation. 


The audio signal bandwidth is about 15 kHz, but subjective tests show that signal articulation (intelligibility) is not affected if all the 
components above 3400 Hz are suppressed.[3] Since the objective in telephone communication is intelligibility rather than high fidelity, 
the components above 3400 Hz are eliminated by a lowpass filter.T] The resulting signal is then sampled at a rate of 8000 samples/s 


(8 kHz). This rate is intentionally kept higher than the Nyquist sampling rate of 6.8 kHz to avoid unrealizable filters required for signal 
reconstruction. Each sample is finally quantized into 256 levels (L= 256), which requires a group of eight binary pulses to encode each 
sample (2%= 256). Thus, a digitized telephone signal consists of data amounting to 8 x 8000= 64,000 or 64 kbit/s, requiring 64,000 
binary pulses per second for its transmission. 


The compact disc (CD), a recent high-fidelity application of A/D conversion, requires the audio signal bandwidth of 20 kHz. Although the 
Nyquist sampling rate is only 40 kHz, an actual sampling rate of 44.1 kHz is used for the reason mentioned earlier. The signal is 
quantized into a rather large number of levels (L= 65,536) to reduce quantizing error. The binary-coded samples are now recorded on 
the CD. 


A HISTORICAL NOTE 


The binary system of representing any number by using 1s and Os was invented by Pingala (ca. 200 B.C.) in India. It was again worked 
out independently in the West by Gottfried Wilhelm Leibniz (1646-1716). He felt a spiritual significance in this discovery, reasoning that 
1 representing unity was clearly a symbol for God, while 0 represented the nothingness. He reasoned that if all numbers can be 
represented merely by the use of 1 and 0, this surely proves that God created the universe out of nothing! 


EXAMPLE 8.5 


1 
A signal x (tf) bandlimited to 3 kHz is sampled at a rate 333% higher than the Nyquist rate. The maximum acceptable error in the 
sample amplitude (the maximum error due to quantization) is 0.5% of the peak amplitude V. The quantized samples are binary-coded. 
Find the required sampling rate, the number of bits required to encode each sample, and the bit rate of the resulting PCM signal. 


= By - 
The Nyquist sampling rate is fyyg= 2 x 3000= 6000 Hz (samples/s). The actual sampling rate is fa = 6000 x (13) = 8000 Hz 


The quantization step is A, and the maximum quantization error is +A/2, where A = 2V/L. The maximum error due to quantization, A/2, 
should be no greater than 0.5% of the signal peak amplitude V. Therefore 


A VV 05 


For binary coding, L must be a power of 2. Hence, the next higher value of L that is a power of 2 is L= 256. Because logz 256= 8, we 
need 8 bits to encode each sample. Therefore the bit rate of the PCM signal is 


8000 x 8 = 64.000 bits/s 


EXERCISE E8.5 
The American Standard Code for Information Interchange (ASCII) has 128 characters, which are binary coded. A certain computer 
generates 100,000 characters per second. Show that 


a. 7 bits (binary digits) are required to encode each character 


b. 700,000 bits/s are required to transmit the computer output. 
[3] Bennett, W. R. Introduction to Signal Transmission. McGraw-Hill, New York, 1970. 


[tlComponents below 300 Hz may also be suppressed without affecting the articulation. 


8.4 DUAL OF TIME SAMPLING: SPECTRAL SAMPLING 


As in other cases, the sampling theorem has its dual. In Section 8.1, we discussed the time-sampling theorem and showed that a signal 
bandlimited to B Hz can be reconstructed from the signal samples taken at a rate of f ; > 2B samples/s. Note that the signal spectrum 
exists over the frequency range (in hertz) of —B to B. Therefore, 2B is the spectral width (not the bandwidth, which is B) of the signal. 
This fact means that a signal x (ft) can be reconstructed from samples taken at a rate f , > the spectral width of X (uw) in hertz (f , > 
2B). 


We now prove the dual of the time-sampling theorem. This is the spectral sampling theorem, that applies to timelimited signals (the 
dual of bandlimited signals). A timelimited signal x (tf) exists only over a finite interval of T seconds, as shown in Fig. 8.15a. Generally, a 
timelimited signal is characterized by x (t)= 0 for t< T 4 andt> T 2 (assuming T 2 > T 1). The signal width or duration is T = T 2 — T 4 
seconds. 
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Figure 8.15: Periodic repetition of a signal amounts to sampling its spectrum. 


The spectral sampling theorem states that the spectrum X (w) of a signal x (f) timelimited to a duration of T seconds can be 
reconstructed from the samples of X (w) taken at a rate R samples/Hz, where R > T (the signal width or duration) in seconds. 


Figure 8.15a shows a timelimited signal x (tf) and its Fourier transform X (w). Although X (uw) is complex in general, it is adequate for 
our line of reasoning to show X (w) as a real function. 


x +4 
X(@) = / xe" “dt = | x(ne dt (8.16) 
—od 0 
We now construct x 79 (ft), a periodic signal formed by repeating x (t) every T 9 seconds (T 9 > T), as depicted in Fig. 8.15b. This 
periodic signal can be expressed by the exponential Fourier series 


2x 
X,(t) = > D,e"™™ WO = Te 


if 
a=-—o 0 


where (assuming T 09 > T) 
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From Eq. (8.16) it follows that 
1 
D, = 7, x (nwo) 


0 
This result indicates that the coefficients of the Fourier series for x 7o (t) are (1/T 9) times the sample values of the spectrum X (w) 
taken at intervals of Wo. This means that the spectrum of the periodic signal x 79 (f) is the sampled spectrum X (Ww), as illustrated in 
Fig. 8.15b. Now as long as T 9 > T, the successive cycles of x (t) appearing in x 7p (t) do not overlap, and x (t) can be recovered from 
X To (ft). Such recovery implies indirectly that X (w) can be reconstructed from its samples. These samples are separated by the 
fundamental frequency f 9= 1/T 9 Hz of the periodic signal x zo (t). Hence, the condition for recovery is T 9 > T; that is, 


1 
fo < ~ Hz 


Therefore, to be able to reconstruct the spectrum X (w) from the samples of X (w), the samples should be taken at frequency intervals 
fo < 1/T Hz. If Ris the sampling rate (Samples/Hz), then 


1 
R= — >t samples/Hz (8.17) 
fo 
SPECTRAL INTERPOLATION 
Consider a signal timelimited to T seconds and centered at T .. we now show that the spectrum X (w) of x (f) can be reconstructed 
from the samples of X (w). For this case, using the dual of the approach employed to derive the signal interpolation formula in Eq. 
(8.11b), we obtain the spectral interpolation formulalt] 


2x 


~ op 
= wT . 
X(w) = He X (na) sine (+ ~nx )e Senet a = 7 T>Tt (8.18) 


For the case in Fig. 8.15, T , = T 9/2. If the pulse x (t) were to be centered at the origin, then 7 , = 0, and the exponential term at the 
extreme right in Eq. (8.18) would vanish. In such a case Eq. (8.18) would be the exact dual of Eq. (8.11b). 


EXAMPLE 8.6000 


The spectrum X (w) of a unit duration signal x (t), centered at the origin, is sampled at the intervals of 1 Hz or 21 rad/s (the Nyquist 
rate). The samples are: 


X(0) =1 and X(+22n) = 0 n=1,2,3,... 


Find x (t). 


We use the interpolation formula (8.18) (with T ,= 0) to construct X (w) from its samples. Since all but one of the Nyquist samples are 
zero, only one term (corresponding to n = 0) in the' summation on the right-hand side of Eq. (8.18) survives. Thus, with X (0)= 1 and T 
= T o= 1, we obtain 
@ 
X(w) = sine (+) and x(t) = reet(t) (8.19) 


For a signal of unit duration, this is the only spectrum with the sample values X (0)= 1 and X (2Trn)= 0 (n # 0). No other spectrum 
satisfies these conditions. 


[t]This can be obtained by observing that the Fourier transform of x Tg (t) is 21 2,D , 8(wW—Nnwo) [see Eq. (7.26)]. We can recover x 


(t) from x T 9 (t) by multiplying the latter with rect (¢ — T .)/T 9, whose Fourier transform is T g sinc (wT o/2)je Jee, Hence, X (Ww) is 
1/21 times the convolution of these two Fourier transforms, which yields Eq. (8.18). 


8.5 NUMERICAL COMPUTATION OF THE FOURIER TRANSFORM: THE DISCRETE FOURIER 
TRANSFORM (DFT) 


Numerical computation of the Fourier transform of x (tf) requires sample values of x (ft) because a digital computer can work only with 
discrete data (sequence of numbers). Moreover, a computer can compute X (w) only at some discrete values of w [samples of X (w)]. 
We therefore need to relate the samples of X (w) to samples of x (f). This task can be accomplished by using the results of the two 
sampling theorems developed in Sections 8.1 and 8.4. 


We begin with a timelimited signal x (tf) (Fig. 8.16a) and its spectrum X (w) (Fig. 8.16b). Since x (ft) is timelimited, X (Ww) is 
nonbandlimited. For convenience, we shall show all spectra as functions of the frequency variable f (in hertz) rather than w. According 
to the sampling theorem, the spectrum X (w) of the sampled signal x (tf) consists of X (Ww) repeating every f s Hz, where f , = 1/T, as 
depicted in Fig. 8.16d.!T] In the next step, the sampled signal in Fig. 8.16c is repeated periodically every T 9 seconds, as illustrated in 
Fig. 8.16e. According to the spectral sampling theorem, such an operation results in sampling the spectrum at a rate of T g samples/Hz. 
This sampling rate means that the samples are spaced at f 9 = 1/T 9 Hz, as depicted in Fig. 8.16f. 


Figure 8.16: Relationship between samples of x (ft) and X (Ww). 


The foregoing discussion shows that when a signal x (f) is sampled and then periodically repeated, the corresponding spectrum is also 
sampled and periodically repeated. Our goal is to relate the samples of x (tf) to the samples of X (w). 


NUMBER OF SAMPLES 
One interesting observation from Fig. 8.16e and 8.16f is that N g, number of samples of the signal in Fig. 8.16e in one period T g is 


identical to N’g, the number of samples of the spectrum in Fig. 8.16f in one period f ,. The reason is 


T ee 
No = = and Ny = = (8.20a) 
But, because 
f= L sm fo= (8.20b) 
= T o= Th < 
T , 
Nya A AE (8.20c) 


ALIASING AND LEAKAGE IN NUMERICAL COMPUTATION 

Figure 8.16f shows the presence of aliasing in the samples of the spectrum X (w). This aliasing error can be reduced as much as 
desired by increasing the sampling frequency f , (decreasing the sampling interval T = 1/f ,). The aliasing can never be eliminated for 
timelimited x (t), however, because its spectrum X (WwW) is nonbandlimited. Had we started out with a signal having a bandlimited 
spectrum X (w), there would be no aliasing in the spectrum in Fig. 8.16f. Unfortunately such a signal is nontimelimited, and its repetition 
(in Fig. 8.16e) would result in signal overlapping (aliasing in the time domain). In this case we shall have to contend with errors in signal 
samples. In other words, in computing the direct or inverse Fourier transform numerically, we can reduce the error as much as we wish, 
but the error can never be eliminated. This is true of numerical computation of direct and inverse Fourier transforms, regardless of the 
method used. For example, if we determine the Fourier transform by direct integration numerically, by using Eq. (7.8a), there will be an 
error because the interval of integration At can never be made zero. Similar remarks apply to numerical computation of the inverse 
transform. Therefore, we should always keep in mind the nature of this error in our results. In our discussion (Fig. 8.16), we assumed x 
(t) to be a timelimited signal. If x (f) were not timelimited, we would need to timelimit it because numerical computations can work only 
with finite data. Further, this data truncation causes error because of spectral spreading (smearing) and leakage, as discussed in 
Section 7.8. The leakage also causes aliasing. Leakage can be reduced by using a tapered window for signal truncation. But this choice 
increases spectral spreading or smearing. Spectral spreading can be reduced by increasing the window width (i.e., more data), which 
increases T g, and reduces f 9 (increases spectral or frequency resolution). 


PICKET FENCE EFFECT 

The numerical computation method yields only the uniform sample values of X (Ww). The major peaks or valleys of X (Ww) can lie 
between two samples and may remain hidden, giving a false picture of reality. Viewing samples is like viewing the signal and its 
spectrum through a "picket fence” with upright posts that are very wide and placed close together. What is hidden behind the pickets is 
much more than what we can see. Such misleading results can be avoided by using a sufficiently large N 9, the number of samples, to 
increase resolution. We can also use zero padding (discussed later) or the spectral interpolation formula [Eq. (8.18)] to determine the 
values of X (w) between samples. 


POINTS OF DISCONTINUITY 
If x (t) or X (Ww) has a jump discontinuity at a sampling point, the sample value should be taken as the average of the values on the two 
sides of the discontinuity because the Fourier representation at a point of discontinuity converges to the average value. 


DERIVATION OF THE DISCRETE FOURIER TRANSFORM (DFT) 


If x (NT) and X (rwg) are the nth and rth samples of x (t) and X (Ww), respectively, then we define new variables x , and X , as 


Xe = Tx(aT) 
To 
= — (nT) (8.2 1a) 
0 
and 
X, = X(ra@o) (8.21b) 
where 
4 
a = 2x fo = == (8.21c) 
To 


We shall now show that x , and X ; are related by the following equations!) 


X; = >. Ane sean (8 22a) 
ant) 
i 2x 
Xn —— X, eit" Qo = @oT i No (8.22b) 
0 ruil 0 


These equations define the direct and the inverse discrete Fourier transforms, with X , the direct discrete Fourier transform (DFT) of x y, 
and x p the inverse discrete Fourier transform (IDFT) of X -. The notation 
y= x, 


is also used to indicate that x , and X , are a DFT pair. Remember that x , is T g/N 9 times the nth sample of x (t) and X ; is the rth 
sample of X (uw). Knowing the sample values of x (f), we can use the DFT to compute the sample values of X (w)-and vice versa. Note, 
however, that x ,, is a function of n (n = 0, 1, 2, ....N 9 — 1) rather than of t and that X , is a function of r (r= 0, 1, 2, .... No — 1) rather 
than of w. Moreover, both x , and X ; are periodic sequences of period N g (Fig. 8.16e, 8.16f). Such sequences are called N g-periodic 
sequences. The proof of the DFT relationships in Eqs. (8.22) follows directly from the results of the sampling theorem. 


The sampled signal x (ft) (Fig. 8.16c) can be expressed as 
No~1 
1) = Se x(nT)8 (t —nT) (8.23) 
a= 


Since 6 (t — nT) <=> e~"*" the Fourier transform of Eq. (8.23) yields 


o-! 
X(w) = D> x(aT ee (8.24) 
a= 


But from Fig. 8.1f [or Eq. (8.4)], it is clear that over the interval |w|< w,/2,X (uw), the Fourier transform of x (f) is X (w)/T, assuming 
negligible aliasing. Hence 

No-1 

an ta Tr hd — jitter Ws 
X(w) =TX(o) =T Yoxatje"" = jal s = 
2 

a=0 

and 
No-1 
X, = X(re) =T D> x(nT)e"" (8.25) 


n=l) 


If we let WoT = Qo, then from Eqs. (8.20a) and (8.20b) 


2x 


2» = @oT = 2n foT = — (8.26) 
No 
Also, from Ec. (8.21a), 
Therefore, Eq. (8.25) becomes 
No-1 on 
X,= > x,e7 1" Qo = Ne (8.27) 


The inverse transform relationship (8.22b) could be derived by using a similar procedure with the roles of tf and w reversed, but here 


we shall use a more direct proof. To prove the inverse relation in Eq. (8.22b), we multiply both sides of Eq. (8.27) by e/MQor and sum 
over ras 


No-1 No—1 [No-1 

x X,e/mMor oe 3; >. Xen Irson gimior 

r=0 r=0 La=0 

th ler cnenginig the order of summation on the right-hand side, we have 
No-1 No-1 ‘No-1 

a x: eimSor S> Xn a el (m—n)Qor 

r=0 n=O r=0 


We can readily show that the inner sum on the right-hand side is zero for n + m, and that the sum is N g when n = m. To avoid a 
break in the flow, the proof is placed in the footnote below.!T] 


Therefore the outer sum will have only one nonzero term when n = m, and it is N 9X p = N 9X pp. 


ee 


22 
x a jmQor 2 Paes 
atime "7 >» . I 


Because X ; is N g periodic, we need to determine the values of X ; over any one period. It is customary to determine X ,; over the 
range (0, N g — 1) rather than over the range (—N 9/2, (N 9/2) — 1).§] 


CHOICE OF T AND T 9 
In DFT computation, we first need to select suitable values for N g and 7 or T g. For this purpose we should first decide on B, the 
essential bandwidth (in hertz) of the signal. The sampling frequency f , must be at least 2B, that is, 


> B (8.29a) 


Moreover, the sampling interval T = 1/f , [Eq. (8.20b)], and 


1 
<= (8.29b) 


Once we pick B, we can choose T according to Eq. (8.29b). Also, 


h==> (8.30) 
To 
where f 9 is the frequency resolution [separation between samples of X (w)]. Hence, if f 9 is given, we can pick T g according to Eq. 
(8.30). Knowing T 9 and T, we determine N 9 from 


Tp 
No 7 
ZERO PADDING 
Recall that observing X ; is like observing the spectrum X (w) through a picket fence. If the frequency sampling interval f g is not 
sufficiently small, we could miss out on some significant details and obtain a misleading picture. To obtain a higher number of samples, 
we need to reduce f 9. Because f 9 = 1/T 9, a higher number of samples requires us to increase the value of T 0, the period of 
repetition for x (ft). This option increases N g, the number of samples of x (t), by adding dummy samples of 0 value. This addition of 
dummy samples is known as zero padding. Thus, zero padding increases the number of samples and may help in getting a better idea 
of the spectrum X (w) from its samples X ,. To continue with our picket fence analogy, zero padding is like using more, and narrower, 
pickets. 


ZERO PADDING DOES NOT IMPROVE ACCURACY OR RESOLUTION 


Actually, we are not observing X (Ww) through a picket fence. We are observing a distorted version of X (w) resulting from the truncation 
of x (t). Hence, we should keep in mind that even if the fence were transparent, we would see a reality distorted by aliasing. Seeing 
through the picket fence just gives us an imperfect view of the imperfectly represented reality. Zero padding only allows us to look at 
more samples of that imperfect reality. It can never reduce the imperfection in what is behind the fence. The imperfection, which is 
caused by aliasing, can only be lessened by reducing the sampling interval 7. Observe that reducing 7 also increases N o, the number 
of samples and is also like increasing the number of pickets while reducing their width. But in this case, the reality behind the fence is 
also better dressed and we see more of it. 


EXAMPLE 8.7 
A signal x (t) has a duration of 2 ms and an essential bandwidth of 10 kHz. It is desirable to have a frequency resolution of 100 Hz in 
the DFT (f 9 = 100). Determine N 9. 


To have f 9 = 100 Hz, the effective signal duration T 9 must be 


1 
>= — = — = 10 ms 
0 
o ~—s«wLOW 
Since the signal duration is only 2 ms, we need zero padding over 8 ms. Also, B = 10,000. Hence, f , = 2B = 20,000 and T = 1/f , = 50 
us. Further, 
N - 20,000 500 
06 FS TT = 
fo 100 


The fast Fourier transform (FFT) algorithm (discussed later: see Section 8.6) is used to compute DFT, where it proves convenient 
(although not necessary) to select N 9 as a power of 2; that is, N g = 2” (n, integer). Let us choose N 9 = 256. Increasing N 9 from 200 
to 256 can be used to reduce aliasing error (by reducing 7), to improve resolution (by increasing T 9 using zero padding), or a 
combination of both: 


i. Reducing Aliasing Error. We maintain the same T 9 so that f 9 = 100. Hence 


I 
ff, = Nofo = 256 x 100 = 25,600 and T= a = 39s 


4 


Thus, increasing N g from 200 to 256 permits us to reduce the sampling interval T from 50 us to 39 Us while maintaining 
the same frequency resolution (f 9 = 100). 


ii. Improving Resolution. Here we maintain the same T = 50 us, which yields 


Ty = NoT = 256(50 x 10~°) = 12.8 ms and f= 
Thus, increasing N g from 200 to 256 can improve the frequency resolution from 100 to 78.125 Hz while maintaining the 
same aliasing error (T = 50 us). 


iii. Combination of These Two Options. We could choose T = 45 us and T 9 = 11.5 ms so that f 9 = 86.96 Hz. 


EXAMPLE 8.8 
Use DFT to compute the Fourier transform of e~2‘u (t). Plot the resulting Fourier spectra. 


We first determine T and T 9. The Fourier transform of e2ty (t) is 1/(jw + 2). This lowpass signal is not bandlimited. In Section 7.6, we 


used the energy criterion to compute the essential bandwidth of a signal. Here, we shall present a simpler, but workable alternative to 
the energy criterion. The essential bandwidth of a signal will be taken as the frequency at which |X (w)| drops to 1% of its peak value 
(see the footnote on page 732). In this case, the peak value occurs at w = 0, where |X (0)| = 0.5. Observe that 


|\X(@)| = —— * — @ > 2 
o+4 


Also, 1% of the peak value is 0.01 x 0.5 = 0.005. Hence, the essential bandwidth B is at w = 21TB, where 


1 100 
|X (w)| o=P =0.005 => B=—Hz 


and from Eq. (8.29b), 


bg 
= oR 200 0.015708 


4 


Had we used 1% energy criterion to determine the essential bandwidth, following the procedure in Example 7.20, we would have 
obtained B = 20.26 Hz, which is somewhat smaller than the value just obtained by using the 1% amplitude criterion. 


The second issue is to determine T 9. Because the signal is not timelimited, we have to truncate it at Tg such that x (T9) << 1.A 


reasonable choice would be T 9 = 4 because x (4) = e-® = 0.000335 < 1. The result is N 0 = T O/T = 254.6, which is not a power of 2. 
Hence, we choose T g = 4, and T = 0.015625 = 1/64, yielding N 9 = 256, which is a power of 2. 


Note that there is a great deal of flexibility in determining T and T 9, depending on the accuracy desired and the computational capacity 
available. We could just as well have chosen T = 0.03125, yielding N 9 = 128, although this choice would have given a slightly higher 
aliasing error. 


Because the signal has a jump discontinuity at t = 0, the first sample (at tf = 0) is 0.5, the averages of the values on the two sides of the 
discontinuity. We compute X ; (the DFT) from the samples of ely (t) according to Eq. (8.22a). Note that X , is the rth sample of X 
(w), and these samples are spaced at fg = 1/T 9 = 0.25 Hz. (Wo = Tr/2 rad/s.) 


Because X ,; is N g periodic, X ; = X(r+256) so that X 256 = X 9. Hence, we need to plot X ; over the range r = 0 to 255 (not 256). 
Moreover, because of this periodicity, X -; = X(-;+256), and the values of X ; over the range r = —127 to —1 are identical to those over 
the range r = 129 to 255. Thus, X -497 = X 129, X -126 = X 130,--.X -1 = X 255. In addition, because of the property of conjugate 
symmetry of the Fourier transform, X _, = X ,*, it follows that X _1 = X 4*, X 2 =X 0%, ..., X -128 = X 128*. Thus, we need X ,; only over 
the range r = 0 to N 0/2 (128 in this case). 


Figure 8.17 shows the computed plots of |X ,| and 2X ;. The exact spectra are depicted by continuous curves for comparison. Note the 
nearly perfect agreement between the two sets of spectra. We have depicted the plot of only the first 28 points rather than all 128 
points, which would have made the figure very crowded, resulting in loss of clarity. The points are at the intervals of 1/T 9 = 1/4 Hz or 
Wo = 1.5708 rad/s. The 28 samples, therefore, exhibit the plots over the range w = 0 to w = 28(1.5708) = 44 rad/s or 7 Hz. 


Figure 8.17: Discrete Fourier transform of an exponential signal ety (t). 


In this example, we knew X (Ww) beforehand and hence could make intelligent choices for B (or the sampling frequency f g). In practice, 
we generally do not know X (w) beforehand. In fact, that is the very thing we are trying to determine. In such a case, we must make an 
intelligent guess for B or f . from circumstantial evidence. We should then continue reducing the value of T and recomputing the 


transform until the result stabilizes within the desired number of significant digits. The MATLAB program, which implements the DFT 
using the FFT algorithm, is presented in Computer Example C8.1. 


COMPUTER EXAMPLE C8.1 
Using MATLAB, repeat Example 8.8. 


First, MATLAB's ££t command is used to compute the DFT. 


>> T 0 = 4; N O = 256; 

>> T= T O/N 0; t = (0:T:T*(N O-1))'; 

>> x = T¥exp(-2*t); x(1) = T*(exp(-2*T 0)4+1)/2; 

>> X xr = fft(x); vr = [-N 0/2:N 0/2-1]'; omega r = r*2*pi/T 0; 


The true Fourier transform is also computed for comparison. 
>> omega = linspace (-pi/T,pi/T,4097); X = 1./(j*omega+t2) ; 


For clarity, we display spectrum over a restricted frequency range. 


>> subplot (211); 

>> plot (omega, abs (X), 'k', omega r, fftshift (abs(X r)), 'ko'); 

>> xlabel ('\omega'); ylabel ('|X(\omega) |') — 

>> axis ([-0.01 40 -0.01 0.51]); 

>> legend ('True FT', ['DFT with T 0 = ',num2str (T 0), 

>> ', NO = ',num2str(N 0)],0); _ = 

>> subplot (212); — 

>> plot (omega, angle (X), 'k', omega_r, fftshift (angle(X_r)), 'ko'); 
>> xlabel ('\omega'); ylabel ('\angle X(\omega) ') 

>> axis ([-0.01 40 -pi/2-0.01 0.01)); 


>> legend ('True FT', ['DFT with T.0 = ', num2str (T_0),. 
>> ', NO = ',num2str(N 0)], 0); 
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Figure C8.1 


EXAMPLE 8.9 
Use DFT to compute the Fourier transform of 8 rect (f). 


This gate function and its Fourier transform are illustrated in Fig. 8.18a and 8.18b. To determine the value of the sampling interval T, we 
must first decide on the essential bandwidth B. In Fig. 8.18b, we see that X (w) decays rather slowly with w. Hence, the essential 
bandwidth B is rather large. For instance, at B = 15.5 Hz (97.39 rad/s), X (w) = —0.1643, which is about 2% of the peak at X (0). 
Hence, the essential bandwidth is well above 16 Hz if we use the 1% of the peak amplitude criterion for computing the essential 
bandwidth. However, we shall deliberately take B = 4 for two reasons: to show the effect of aliasing and because the use of B > 4 
would give an enormous number of samples, which could not be conveniently displayed on the page without losing sight of the 
essentials. Thus, we shall intentionally accept approximation to clarify the concepts of DFT graphically. 


The choice of B = 4 results in the sampling interval T = 1/2B = 1/8. Looking again at the spectrum in Fig. 8.18b, we see that the choice 
of the frequency resolution fg = 1/4 Hz is reasonable. Such a choice gives us four samples in each lobe of X (w). In this case T g = 1/f 
0 = 4 seconds and N 9 = T Q/T = 32. The duration of x (t) is only 1 second. We must repeat it every 4 seconds (T g = 4), as depicted in 
Fig. 8.18c, and take samples every % second. This choice yields 32 samples (N 9 = 32). Also, 
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Figure 8.18: Discrete Fourier transform of a gate pulse. 
x =Tx(nT) 

id 

= qXx(nT) 


Since x (ft) = 8 rect (¢), the values of x , are 1, 0, or 0.5 (at the points of discontinuity), as illustrated in Fig. 8.18c, where x ,, is depicted 
as a function of t as well as n, for convenience. 


In the derivation of the DFT, we assumed that x (ft) begins at t = 0 (Fig. 8.16a), and then took N g samples over the interval (0, T 9). In 
the present case, however, x (t) begins at — 1/2. This difficulty is easily resolved when we realize that the DFT obtained by this 
procedure is actually the DFT of x , repeating periodically every T g seconds. Figure 8.18c clearly indicates that periodic repeating the 
segment of x , over the interval from —2 to 2 seconds yields the same signal as the periodic repeating the segment of x , over the 
interval from 0 to 4 seconds. Hence, the DFT of the samples taken from —2 to 2 seconds is the same as that of the samples taken 
from 0 to 4 seconds. Therefore, regardless of where x (ft) starts, we can always take the samples of x (ft) and its periodic extension over 
the interval from 0 to T 9. In the present example, the 32 sample values are 


I Q<a<3 and 29<n” < 31 
xy = <0 5 <n <27 
0.5 n= 4,28 


Observe that the last sample is at ¢ = 31/8, not at 4, because the signal repetition starts at t= 4, and the sample at tf = 4 is the same as 
the sample at t = 0. Now, N 9 = 32 and Qo = 211/32 = 11/16. Therefore [see Eq. (8.22a)] 


31 
an= ) per ee 


n=0 


Values of X ; are computed according to this equation and plotted in Fig. 8.18d. 


The samples X , are separated by fg = 1/T 9 Hz. In this case T 9 = 4, so the frequency resolution f 9 is 1/4 Hz, as desired. The folding 
frequency f ,/2 = B = 4 Hz corresponds to r= N 9/2 = 16. Because X is N 9 periodic (N g = 32), the values of X , for r= —16 ton = 
—1 are the same as those for r= 16 to n = 31. For instance, X 47 = X -45, X 4g = X -14, and so on. The DFT gives us the samples of 
the spectrum X (Ww). 


For the sake of comparison, Fig. 8.18d also shows the shaded curve 8 sinc (w/2), which is the Fourier transform of 8 rect (t). The 
values of X , computed from the DFT equation show aliasing error, which is clearly seen by comparing the two superimposed plots. The 
error in X 9 is just about 1.3%. However, the aliasing error increases rapidly with r. For instance, the error in X g is about 12%, and the 
error in X 49 is 33%. The error in X 44 is a whopping 72%. The percent error increases rapidly near the folding frequency (r = 16) 
because x (t) has a jump discontinuity, which makes X (w) decay slowly as 1/Ww. Hence, near the folding frequency, the inverted tail 
(due to aliasing) is very nearly equal to X (w) itself. Moreover, the final values are the difference between the exact and the folded 
values (which are very close to the exact values). Hence, the percent error near the folding frequency (r = 16 in this case) is very high, 
although the absolute error is very small. Clearly, for signals with jump discontinuities, the aliasing error near the folding frequency will 
always be high (in percentage terms), regardless of the choice of N 9. To ensure a negligible aliasing error at any value r, we must 
make sure that N g >> r. This observation is valid for all signals with jump discontinuities. 


COMPUTER EXAMPLE C8.2 
Using MATLAB, repeat Example 8.9. 


First, MATLAB's ££t command is used to compute the DFT. 


>> T.0 = 4; N_O = 32; T = T_O/N_0; 
>> x n = [ones(1,4) 0.5 zeros(1,23) 0.5 ones(1,3)]'; 
>> X vr = fft(x n); vr = [-N 0/2:N 0/2-1]'; omega r = r*2*pi/T 0; 


The true Fourier transform is also computed for comparison. 
>> omega = linspace(-pi/T,pi/T,4097); X = 8*sinc(omega/ (2*pi)); 


Next, the spectrum is displayed. 
>> figure(1); subplot (2,1,1); 


>> plot(omega, abs(X),'k', omega r,fftshift (abs(X r)),'ko'); 

>> xlabel('\omega'); ylabel('|X(\omega)|'); axis tight 

>> legend('True FT',['T 0 = ',num2str(T 0), ae % 

>> ", NO = ',num2str(N 0)J,0);_ 

>> subplot (2,1,2); ~ 

>> plot (omega, angle (X),'k',omega_r,fftshift(angle(X_r)),'ko'); 

>> xlabel('\omega'); ylabel('\angle X(\omega)'); axis([-25 25 -.5 3.5]); 


Notice that the DFT approximation does not perfectly follow the true Fourier transform, especially at high frequencies. As in Example 
8.9, this is because the parameter B is deliberately set too small. 
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Figure C8.2 
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8.5-1 Some Properties of the DFT 


The discrete Fourier transform is basically the Fourier transform of a sampled signal repeated periodically. Hence, the properties derived 
earlier for the Fourier transform apply to the DFT as well. 


LINEARITY 
If Xn <=> X, and Sn => Gy, then 
Xn + 2Rn > A,X, + 2G, (8.31) 
The proof is trivial. 
CONJUGATE SYMMETRY 


From the conjugation property ¥'(f) <=> X*(—@), we have 


xi<— X', (8.32a) 
From this equation and the time-reversal property, we obtain 
xt, <> Xx? (8.32b) 


When x (f) is real, then the conjugate symmetry property states that X*(w) = X (— ww). Hence, for real x yp 


X'=X_, 


Moreover, X ; is N 9 periodic. Hence 


Xx; _ XNo r (8.32c) 


Because of this property, we need compute only half the DFTs for real x ,. The other half are the conjugates. 


TIME SHIFTING (CIRCULAR SHIFTING)[T] 


Xn <=> X,e7 et (8.33) 
Proof. We use Eq. (8.22b) to find the inverse DFT of X , e//@okas 
yj Mon 1 Nox! 
ri x: eit Qok pjreon seared > 3 X, et 2on—*) = Xq_4 
0 r=0 a 
FREQUENCY SHIFTING 
Xe o> Xe (8.34) 


Proof. This proof is identical to that of the time-shifting property except that we start with Eq. (8.22a). 
PERIODIC CONVOLUTION 
Xn D2, <> X,G, (8.35a) 


and 


| 
Xn8n —_ —oie MG, (8.35b) 


For two N g-periodic sequences x , and g py, the periodic convolution is defined by 


Xn DSn = D> XeSn-k =D, eXn-e (8.36) 


t=O t=0 


To Hk ae (8.35a), we find the DFT of periodic convolution x , *n Pen gnas 


No-1 No-1 No-1 
> 3 XeBn-e J eo" = Dae | D Baer" 
a0 &=0 k=0 i 
No-1 
= > xx(G,e"™*) = X,G, 
0 


Equation (8.35b) can be proved in the same way. 
For periodic sequences, the convolution can be visualized in terms of two sequences, with one sequence fixed and the other inverted 
and moved past the fixed sequence, one digit at a time. If the two sequences are N g periodic, the same configuration will repeat after 


N 9 shifts of the sequence. Clearly the convolution x ,, *n P gn g pn becomes N 9 periodic. Such convolution can be conveniently 
visualized in terms of N 9 sequences, as illustrated in Fig. 8.19, for the case of N 9 = 4. The inner N g-point sequence x ,, is clockwise 
and fixed. The outer N g-point sequence g , is inverted so that it becomes counterclockwise. This sequence is now rotated clockwise 


one unit at a time. We multiply the overlapping numbers and add. For example, the value of x , ¥n Pe, g pat n =0 (Fig. 8.19) is 


(7\\ \ (7 
J) LZ. 


Figure 8. 19: Graphical nian of periodic convolution. 


Xo8o + X183 + X282 + X321 
and the value of x , n 1) &ng py at n= 1 is (Fig. 8.19) 
Xo81 + X10 + X283 + A322 


and so on. 


8.5-2 Some Applications of the DFT 


The DFT is useful not only in the computation of direct and inverse Fourier transforms, but also in other applications such as 
convolution, correlation, and filtering. Use of the efficient FFT algorithm, discussed shortly (Section 8.6), makes it particularly appealing. 


LINEAR CONVOLUTION 


Let x (t) and g (ft) be the two signals to be convolved. In general, these signals may have different time durations. To convolve them by 
using their samples, they must be sampled at the same rate (not below the Nyquist rate of either signal). Let x , (0 <n < Ny, — 1) 
and g , (0 <n < N 2 — 1) be the corresponding discrete sequences representing these samples. Now, 

c(t) = x(t) * g(t) 

and if we define three sequences as x , — Tx (nT), g , — Tg (nT), andc , — Tc (nT), then!T] 

Cn = Xn * Bn 


where we define the linear convolution sum of two discrete sequences x , and g , as 
mw» 


Ch = Xp * 2n = >» Xt Bn-k 


k=—00 


Because of the width property of the convolution, c , exists forO <n < N4+WN 9 — 1. To be able to use the DFT periodic 


convolution technique, we must make sure that the periodic convolution will yield the same result as the linear convolution. In other 
words, the signal resulting from the periodic convolution must have the same length (N ; + N 2 — 1) as that of the signal resulting from 
linear convolution. This step can be accomplished by adding N 2 — 1 dummy samples of zero value to x , and N 4 — 1 dummy 
samples of zero value to g , (zero padding). This procedure changes the length of both x , andg , to N 4 + N 2 — 1. The periodic 
convolution now is identical to the linear convolution except that it repeats periodically with period N 4 + N 9 — 1. A little reflection will 
show that in such a case the circular convolution procedure in Fig. 8.19 over one cycle (0 < n < N1+WN 2 — 1) is identical to the 
linear convolution of the two sequences x , and g ,. We can use the DFT to find the convolution x , * g , in three steps, as follows: 


1. Find the DFTs X ; and G ; corresponding to suitable padded x y and g pn. 
2. Multiply X , by G ,. 


3. Find the IDFT of X -G ,;. This procedure of convolution, when implemented by the fast Fourier transform algorithm 
(discussed later), is known as the fast convolution. 


FILTERING 


We generally think of filtering in terms of some hardware-oriented solution (namely, building a circuit with RLC components and 
operational amplifiers). However, filtering also has a software-oriented solution [a computer algorithm that yields the filtered output y (f) 
for a given input x (f)]. This goal can be conveniently accomplished by using the DFT. If x (t) is the signal to be filtered, then X ,, the 
DFT of x y, is found. The spectrum X ,; is then shaped (filtered) as desired by multiplying X ; by H ,, where H , are the samples of H 
(w) for the filter [H , = H (rw )]. Finally, we take the IDFT of X -H , to obtain the filtered output y ,[y , = Ty (nT)]. This procedure is 
demonstrated in the following example. 


EXAMPLE 8.10 


The signal x (f) in Fig. 8.20a is passed through an ideal lowpass filter of frequency response H (w) depicted in Fig. 8.20b. Use the DFT 
to find the filter output. 


~ f(z) 


id) 


Figure 8.20: DFT solution for filtering x (tf) through H (w). 


We have already found the 32-point DFT of x (tf) (see Fig. 8.18d). Next we multiply X ; by H ,. To find H ,, we recall using f 9 = 1/4 in 
computing the 32-point DFT of x (ft). Because X ; is 32-periodic, H , must also be 32-periodic with samples separated by 1/4 Hz. This 
fact means that H , must be repeated every 8 Hz or 1611 rad/s (see Fig. 8.20c). The resulting 32 samples of H , over (0 < w< 16TT) 
are as follows: 


I QO<r<7 and 25<r<3l 
Py eR a 9<7r<23 
0.5 r=68,24 


We multiply X ; with H ,. The desired output signal samples y , are found by taking the inverse DFT of X -H ,. The resulting output 


signal is illustrated in Fig. 8.20d. Table 8.2 gives a printout of x p,X>,H,, Y,y, and yp. 


Table 8.2 
= Open table as spreadsheet 


[5 [o_[-t32_ [1-133 _[oosses 
(6 [o_[-t4e7 [1 _[-t497 [0.05608 


fio [o_[oses2 [0 [0.000 | -0.01065 
fit [o_[osrre [0 [0.000 | 0.007156 
fis [0 [000 [0 [0.000 [001260 
f20__[o [000 [0 [0.000 _[oorss¢ 
[zr [o_[osrre [0 [0.000 | 0.002156 
[2s [o__[-osste [1 [0.8616 [001383 
[as fo [1497 [11497 | 0.05608 


COMPUTER EXAMPLE C8.3 


Solve Example 8.10 using MATLAB. 


>> T 0 = 4; NO = 32; T= T O/N 0; n = (0:N O-1); 
>> x n = [ones(1,4) 0.5 zeros(1,23) 0.5 ones(1,3 
>> H r = [ones(1,8) 0.5 zeros(1,15) 0.5 ones(1,7 
>> Yr= Her.*X vr; yn = iffft(yY xr); 

>> figure(1); subplot(2,2,1); stem(n,x n,'k'); 

>> xlabel('n'); ylabel('x n'); axis([0 31 -.1 1.1 
>> subplot (2,2,2); stem(r,real(X_r),'k') 

>> xlabel('r'); ylabel('X r'); axis([0 31 -2 8]) 
>> subplot (2,2,3); stem(n, real(y n),'k'); 

>> xlabel('n'); ylabel('y n'); axis([0 31 -.1 1.1 
>> subplot (2,2,4); stem(r, X r.*H r,'k'); 

>> xlabel('r'); ylabel('Y r = X RH r'); 


Figure C8.3 


[tlThere is a multiplying constant 1/T for the spectrum in Fig. 8.16d [see Eq. (8.4)], but this is irrelevant to our discussion here. 


[Tin Eqs. (8.22a) and (8.22b), the summation is performed from 0 to N g — 1. It is shown in Section 9.1-2 [Eqs. (9.12) and (9.13)] that 
the summation may be performed over any successive N 9 values of rn or r. 


[tlWe show that 


J elt _ {No  k=0, No, +2No, ... — 
~ 10 otherwise : 


aad 


Recall that QgN 9=211. So elkw in = 1 when k= 0, + Ng, +2N g,... Hence, the sum on the left-hand side of Eq. (8.28) is N 9. To 
compute the sum for other values of k, we note that the sum on the left-hand side of Eq. 8.28) is a geometric progression with common 
ratio « = e@lkQo. Therefore, (see Section B.7-4) 
No-l i elkQoNo _ 4 saa 

Dae 0 axe arm _ 1) 
ye ars Si ol e 1) 
a=0 
[tlThe DFT equations (8.22) represent a transform in their own right, and they are exact. There is no approximation. However, x , and 
X ,, thus obtained, are only approximations to the actual samples of a signal x (t) and of its Fourier transform X (w). 


[T]Also known as circular shifting because such a shift can be interpreted as a circular shift of the N o samples in the first cycleO <n 
<«<No- 1. 


[tlWe can show that!4] ¢ n= limt_ 9X n*g n- Because T +# 0 in practice, there will be some error in this equation. This error is inherent 
in any numerical method used to compute convolution of continuous-time signals. 


[TlLathi, B. P. Linear Systems and Signals. Berkeley-Cambridge Press, Carmichael, CA, 1992. 


8.6 THE FAST FOURIER TRANSFORM (FFT) 


The number of computations required in performing the DFT was dramatically reduced by an algorithm developed by Cooley and Tukey 
in 1965.15]. This algorithm, known as the fast Fourier transform (FFT), reduces the number of computations from something on the 
order of N 02 to N g log N g. To compute one sample X , from Eq. (8.22a), we require N g complex multiplications and N g — 1 
complex additions. To compute N 9 such values (X ; for r= 0, 1, ..., Ng — 1), we require a total of N 02 complex multiplications and N 
o (N g — 1) complex additions. For a large N g, these computations can be prohibitively time-consuming, even for a high-speed 
computer. The FFT algorithm is what made the use of Fourier transform accessible for digital signal processing. 


HOW DOES FFT REDUCE NUMBER OF COMPUTATIONS? 
It is easy to understand the magic of FFT. The secret is in the linearity of the Fourier transform, and also of the DFT. Because of 


linearity, we can compute the Fourier transform of a signal x (f) as a sum of the Fourier transforms of segments of x (ft) of shorter 
duration. The same principle applies to computation of DFT. Consider a signal of length N 9 = 16 samples. As seen earlier, DFT 


computation of this sequence requires N 02 = 256 multiplications and N g (N 9 — 1) = 240 additions. We can split this sequence in two 
shorter sequences, each of length 8. To compute DFT of each of these segments, we need 64 multiplications and 56 additions. Thus, 
we need a total of 128 multiplications and 112 additions. Suppose, we split the original sequence in four segments of length 4 each. To 
compute the DFT of each segment, we require 16 multiplications and 12 additions. Hence, we need a total of 64 multiplications and 48 
additions. If we split the sequence in eight segments of length 2 each, we need 4 multiplications and 2 additions for each segment, 
resulting in a total of 32 multiplications and 8 additions. Thus, we have been able to reduce the number of multiplications from 256 to 32 
and the number of additions from 240 to 8. Moreover, some of these multiplications turn out to be multiplications by 1 or —1. All this 
fantastic economy in number of computations is realized by the FFT without any approximation! The values obtained by the FFT are 
identical to those obtained by DFT. In this example, we considered a relatively small value of N 9 = 16. The reduction in number of 
computations is much more dramatic for higher values of N o. 


The FFT algorithm is simplified if we choose N 9 to be a power of 2, although such a choice is not essential. For convenience, we 
define 


Wg oO wel (8.37) 
so that 
No-! 
X=) mW Or sN-! (8.38a) 
n=l 
and 
I No-1 
= 5 So XW" = OsnsN-1 (8.38b) 


“ fa 


Although there are many variations of the Tukey-Cooley algorithm, these can be grouped into two basic types: decimation in time and 
decimation in frequency. 


THE DECIMATION-IN-TIME ALGORITHM 
Here we divide the N g-point data sequence x , into two (N 9/2)-point sequences consisting of even-and odd-numbered samples, 


respectively, as follows: 
XO» X25 X4, +++ y RH, 2) %1, X3; XS, +++» XN, 1 
eo 


Sequence 2x sequence hi, 


Then, from Eq. (8.38a), 


(No/2)-1 (No/2)-1 
X= 0 xe Waer t+ DO xe We (8.39) 
nro nai) 
Also, since 
Wroj2 = Wr, (8.40) 
we have 
(No/2)=1 (No/D—1 
X= > xmWi nt Wh, D> xm Wate 
n= a=0 
= G, + Wy, 0<r<N)-1 (8.41) 


where G ; and H ,are the (N 9/2)-point DFTs of the even-and odd-numbered sequences, g , and h py, respectively. Also, G , and H ,, 
being the (N 9/2)-point DFTs, are (N 9/2) periodic. Hence 


G +.(No/2) = G 
se , (8.42) 
A, .(No/2) = A, 
Moreover, 
r+(No/2) _ No/2 ypr _ ,-itwr r 
Wx, = Wy, Wy, = ¢°7" Wy, = — Wy, (8.43) 


From Eqs. (8.41), (8.42), and (8.43), we obtain 


Xr4(No/2) =G,- Wy, 4 (8.44) 
This property can be used to reduce the number of computations. We can compute the first N 9/2 points (0 < n « (N 09/2) — 1) of X, 


by using Eq. (8.41) and the last N 9/2 points by using Eq. (8.44) as 


X, = G, + Wy, H, Q<r< —1 (8.45a) 


Xp. =Gr-Wh,H, O<r< (8.45b) 


Thus, an N 9-point DFT can be computed by combining the two (N 9/2)-point DFTs, as in Eqs. (8.45). These equations can be 


represented conveniently by the signal flow graph depicted in Fig. 8.21. This structure is known as a butterfly. Figure 8.22a shows the 
implementation of Eqs. (8.42) for the case of N 9 = 8. 


G, a 


WN, 


H, X)+-(No/2} 
Figure 8.21: Butterfly signal flow graph. 
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Figure 8.22: Successive steps in an 8-point FFT. 


The next step is to compute the (N 09/2)-point DFTs G , and H ,. We repeat the same procedure by dividing g , and hy into two (N 
9/4)-point sequences corresponding to the even-and odd-numbered samples. Then we continue this process until we reach the one- 
point DFT. These steps for the case of N g / 8 are shown in Fig. 8.22a, 8.22b, and 8.22c. Figure 8.22c shows that the two-point DFTs 
require no multiplication. 


To count the number of computations required in the first step, assume that G ;, and H ; are known. Equations (8.45) clearly show that 
to compute all the N 9 points of the X ,;, we require N 9 complex additions and N 9/2 complex multiplications!T] (corresponding to W Ae 
H »). 


In the second step, to compute the (N 9/2)-point DFT G ; from the (N 9/4)-point DFT, we require N 9/2 complex additions and N 9/4 
complex multiplications. We require an equal number of computations for H ,. Hence, in the second step, there are N 9 complex 
additions and N 9/2 complex multiplications. The number of computations required remains the same in each step. Since a total of logo 
N 9 steps is needed to arrive at a one-point DFT, we require, conservatively, a total of N 9 log2 N g complex additions and (N 9/2) logo 
N 9 complex multiplications, to compute the N g-point DFT. Actually, as Fig. 8.22c shows, many multiplications are multiplications by 1 
or —1, which further reduces the number of computations. 


The procedure for obtaining IDFT is identical to that used to obtain the DFT except that W jo = el (emi'o) instead of e~/ (27/N 0) (in 
addition to the multiplier 1/N 9). Another FFT algorithm, the decimation-in-frequency algorithm, is similar to the decimation-in-time 
algorithm. The only difference is that instead of dividing x , into two sequences of even-and odd-numbered samples, we divide x , into 
two sequences formed by the first N 9/2 and the last N 9/2 digits, proceeding in the same way until a single-point DFT is reached in 
log N 9 steps. The total number of computations in this algorithm is the same as that in the decimation-in-time algorithm. 


[5]Cooley, J. W., and J. W. Tukey. An algorithm for the machine calculation of complex fourier series. 


[T]Actully No/2 is a conservative figure because some multiplications corresponding to the cases of W'No = 1,j, and so on, are 
eliminated. 


8.7 SUMMARY 


A signal bandlimited to B Hz can be reconstructed exactly from its samples if the sampling rate f .> 2B Hz (the sampling theorem). 
Such a reconstruction, although possible theoretically, poses practical problems such as the need for ideal filters, which are unrealizable 
or are realizable only with infinite delay. Therefore, in practice, there is always an error in reconstructing a signal from its samples. 
Moreover, practical signals are not bandlimited, which causes an additional error (aliasing error) in signal reconstruction from its 
samples. When a signal is sampled at a frequency f , Hz, samples of a sinusoid of frequency (f ./2) + x Hz appear as samples of a 
lower frequency (f ./2) — x Hz. This phenomenon, in which higher frequencies appear as lower frequencies, is known as aliasing. 
Aliasing error can be reduced by bandlimiting a signal to f ,/2 Hz (half the sampling frequency). Such bandlimiting, done prior to 
sampling, is accomplished by an antialiasing filter that is an ideal lowpass filter of cutoff frequency f ./2 Hz. 


The sampling theorem is very important in signal analysis, processing, and transmission because it allows us to replace a continuous- 
time signal with a discrete sequence of numbers. Processing a continuous-time signal is therefore equivalent to processing a discrete 
sequence of numbers. This leads us directly into the area of digital filtering (discrete-time systems). In the field of communication, the 
transmission of a continuous-time message reduces to the transmission of a sequence of numbers. This opens doors to many new 
techniques of communicating continuous-time signals by pulse trains. 


The dual of the sampling theorem states that for a signal timelimited to T seconds, its spectrum X (Ww) can be reconstructed from the 
samples of X (w) taken at uniform intervals not greater than 1/T Hz. In other words, the spectrum should be sampled at a rate not less 
than T samples/Hz. 


To compute the direct or the inverse Fourier transform numerically, we need a relationship between the samples of x (t) and X (w). The 
sampling theorem and its dual provide such a quantitative relationship in the form of a discrete Fourier transform (DFT). The DFT 
computations are greatly facilitated by a fast Fourier transform (FFT) algorithm, which reduces the number of computations from 


something on the order of N 92 to Ng log No. 
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MATLAB SESSION 8: THE DISCRETE FOURIER TRANSFORM 


As an idea, the discrete Fourier transform (DFT) has been known for hundreds of years. Practical computing devices, however, are 
responsible for bringing the DFT into common use. MATLAB is capable of DFT computations that would have been impractical not too 


many years ago. 


M8.1 Computing the Discrete Fourier Transform 


The MATLAB command fft (x) computes the DFT of a vector x that is defined over (0 < n < Ng — 1) (Problem 8.M—1 considers 
how to scale the DFT to accommodate signals that do not begin at n = 0.) As its name suggests, the function fft uses the 
computationally more efficient fast Fourier transform algorithm when it is appropriate to do so. The inverse DFT is easily computed by 
using the if£ft function. 


To illustrate MATLAB's DFT capabilities, consider 50 points of a 10 Hz sinusoid sampled at f , = 50 Hz and scaled by T ‘1/f s. 


1/50; NO = 50; n = (0:N 0-1); 
T*cos (2*pi*10*n*T) ; 


>> T 
>> X 


In this case, the vector x contains exactly 10 cycles of the sinusoid. The ££t command computes the DFT. 
>> X = fft (x); 


Ix(f)| 


0 D 10 1 22 035 1 45-350 
f (Hz) 
Figure M8.1: |X (f)| computed over (0 < f< 50) by using fft. 


Since the DFT is both discrete and periodic, f£t needs to return only the N g discrete values contained in the single period (0 < f<f 


s)- 


While X ; can be plotted as a function of r, it is more convenient to plot the DFT as a function of frequency f A frequency vector, in 
hertz, is created by using N 9 and T. 


>> £f = (O:N 0-1) / (T*N 0); 
>> stem (f, abs (X), 'k"); axis ([0 50 -0.05 0.55]); 
>> xlabel ('f [Hz]'); ylabel ('|X(f)1|'); 


As expected, Fig. M8.1 shows content at a frequency of 10 Hz. Since the time-domain signal is real, X (f) is conjugate symmetric. Thus, 
content at 10 Hz implies equal content at —10 Hz. The content visible at 40 Hz is an alias of the —10 Hz content. 


Often, it is preferred to plot a DFT over the principal frequency range (—f ,/2 < f< f./2). The MATLAB function fftshift properly 
rearranges the output of £ft to accomplish this task. 


>> stem (f-1/(T*2), fftshift (abs (X)), 'k'); axis ([-25 25 -0.05 0.55]); 
>> xlabel ('f [Hz]'); ylabel ('|X(f)1|'); 


When we use fftshift, the conjugate symmetry that accompanies the DFT of a real signal becomes apparent, as shown in Fig. 
M8.2. 


—25 -20-15-10 -5 0 5 10 15 20 25 
f (Hz) 
Figure M8.2: |X (f)| displayed over (—25 « f < 25) by using fftshift. 


LX(f) 


-25 -20-15-10 -5 O 5 10 15 20 25 
f (Hz) 
Figure M8.3: 2X (f) displayed over (—25 « f< 25). 


Since DFTs are generally complex valued, the magnitude plots of Figs. M8.1 and M8.2 offer only half the picture; the signal's phase 
spectrum, shown in Fig. M8.3, completes it. 


>> stem (f-1/(T*2), fftshift (angle (X)), 'k'); axis ([-25 25 -1.1*pi 1.1*pi]); 
>> xlabel ('f [Hz]'); ylabel (' KEV" Gg 


Since the signal is real, the phase spectrum necessarily has odd symmetry. Additionally, the phase at +10 Hz is zero, as expected for a 
zero-phase cosine function. More interesting, however, are the phase values found at the remaining frequencies. Does a simple cosine 
really have such complicated phase characteristics? The answer, of course, is no. The magnitude plot of Fig. M8.2 helps identify the 
problem: there is zero content at frequencies other than +10 Hz. Phase computations are not reliable at points where the magnitude 
response is zero. One way to remedy this problem is to assign a phase of zero when the magnitude response is near or at zero. 


M8.2 Improving the Picture with Zero Padding 


DFT magnitude and phase plots paint a picture of a signal's spectrum. At times, however, the picture can be somewhat misleading. 
Given a sampling frequency f , = 50 Hz and a sampling interval T = 1/f ,, consider the signal 


yla] = Tei (104)ar 


This complex-valued, periodic signal contains a single positive frequency at 10 4 Hz. Let us compute the signal's DFT using 50 
samples. 

>> y = T*exp (j*2*pi* (1041/3) *n*T); Y = f£t (y); 

>> stem (f-25, fftshift (abs (Y)), 'k'); axis ([-25 25 -0.05 1.05]); 

>> xlabel ('f [Hz]'); ylabel ('|Y(f)1|'); 


In this case, the vector y contains a noninteger number of cycles. Figure M8.4 shows the significant frequency leakage that results. 
Since y[n] is not real, also notice that the DFT is not conjugate symmetric. 


0 scssaurmenevnnnnssiaiteasttlh a 
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Figure M8.4: |Y (f)| using 50 data points. 


_ 


= 04 
0.3 
0.2 
0.1 
0 

-25 -20-15-10 -5 0 5 10 15 20 25 

f diz) 

Figure M8.5: |Y 7, (f)| using 50 data points padded with 550 zeros. 


In this example, the discrete DFT frequencies do not include the actual 10 % Hz frequency of the signal. Thus, it is difficult to determine 
the signal's frequency from Fig. M8.4. To improve the picture, the signal is zero-padded to 12 times its original length. 


>> Y zp = [y, zeros (1, 1l*length (y))]; Y zp = fft (y zp); 

>> f zp = (0:12*N 0-1) / (T*12*N 0); — — 

>> stem (f zp-25, fftshift (abs (Y_zp)), 'k.'); axis ([-25 25 -0.05 1.05]); 
>> xlabel ('f [Hz]'); ylabel ('|Y {zp} (f£) |'); 


Figure M8.5 correctly shows the peak frequency at 10 % Hz and better represents the signal's spectrum. 


It is important to keep in mind that zero padding does not increase the resolution or accuracy of the DFT. To return to the picket fence 
analogy, zero padding increases the number of pickets in our fence but cannot change what is behind the fence. More formally, the 
characteristics of the sinc function, such as main beam width and sidelobe levels, depend on the fixed width of the pulse, not on the 
number of zeros that follow. Adding zeros cannot change the characteristics of the sinc function and thus cannot change the resolution 
or accuracy of the DFT. Adding zeros simply allows the sinc function to be sampled more finely. 


M8.3 Quantization 


A b-bit analog-to-digital converter (ADC) samples an analog signal and quantizes amplitudes by using 2° discrete levels. This 
quantization results in signal distortion that is particularly noticeable for small 6. Typically, quantization is classified as symmetric or 
asymmetric. As discussed earlier, asymmetric quantization uses zero as a quantization level, which can help suppress low-level noise. 


Program MS8P1 quantizes a signal using either symmetric quantization or asymmetric quantization. If available, the signal processing 
toolbox functions uencode and udecode can also be used for symmetric quantization, but not for asymmetric quantization. 


function [xq] = MS8Pl1 (x, xmax, b, method); 
MS8P1.m : MATLAB Session 8, Program 1 
Function M-file quantizes x over (-xmax, xmax) using 2%b levels. 


AP AP alP AP 


Both symmetric and asymmetric quantization are supported. 
INPUTS: x = input signal 


xmax = maximum magnitude of signal to be quantized 

b = number of quantization bits 

method = default 'sym' for symmetrical, ‘asym' for asymmetrical 
OUTPUTS: xq = quantized signal 
if (nargin<3), 


AP AP al? ol? 


disp('Insufficient number of inputs.'); return 
elseif (nargin==3), 

method = 'sym'; 

elseif (nargin>4), 

disp ('Too many inputs.'); return 

end 


switch lower (method) 
case ‘asym' 

offset = 1/2; 

case 'sym' 


offset = 0; 

otherwise 

disp ('Unrecognized quantization method.'); return 
end 

gq = floor (2*b* ((x+xmax) / (2*max)) + offset); 

1 = find(q>2*%b-1); q(i) = 2%b-1; 

i = find (q<0); q(i) = 0; 

xq = (q- (2%(b-1) (1/2-offset))) * 2*xmax / (2%b)); 


Several MATLAB commands require discussion. First, the nargin function returns the number of input arguments. In this program, 
nargin is used to ensure that a correct number of inputs is supplied. If the number of inputs supplied is incorrect, an error message is 
displayed and the function terminates. If only three input arguments are detected, the quantization type is not explicitly specified and the 
program assigns the default symmetric method. 


As with many high-level languages such as C, MATLAB supports general switch/case structures:!T] 


switch switch_expr, 
case case_expr, 
statements; 


otherwise, 
statements; 
end 


MS8P1 switches among cases of the string method. In this way, method-specific parameters are easily set. The command lower is 
used to convert a string to all lowercase characters. In this way, strings such as SYM, Sym, and sym are all indistinguishable. Similar to 
lower, the MATLAB command upper converts a string to all uppercase. 


Quantization is accomplished by appropriately scaling and shifting the input and then rounding the result. The floor (q) command 
rounds elements of q to the nearest integer toward minus infinity. Mathematically, it computes |q |. To accommodate different types of 
rounding, MATLAB supplies three other rounding commands: ceil, round, and fix. The command ceil (q) rounds elements of 
q to the nearest integers toward infinity, ([q]); the command round (q) rounds elements of q toward the nearest integer; the command 
fix(q) rounds elements of q to the nearest integer toward zero. For example, if gq = [-0.5 0.5];, floor (q) yields [-1 0], 
ceil (q) yields [0 1], round (q) yields [-1 1], and fix(q) yields [0 0]. The final aspect of quantization in MS8P1 is 
accomplished by means of the find command, which is used to identify values outside the maximum allowable range for saturation. 


To verify operation, MS8P1 is used to determine the transfer characteristics of a symmetric 3-bit quantizer operating over (—10, 10). 


>> x = (-10: .0001: 10); 

>> xsq = MS8P1 (x, 10, 3, 'sym'); 

>> plot (x, xsq, 'k'); grid; 

>> xlabel ('Quantizer input'); ylabel ('Quantizer output'); 


Figure M8.6 shows the results. Figure M8.7 shows the transfer characteristics of an asymmetric 3-bit quantizer. The asymmetric 
quantizer includes zero as a quantization level, but at a price: quantization errors exceed A/2 = 1.25 for input values greater than 8.75. 
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Figure M8.6: Transfer characteristics of a symmetric 3-bit quantizer. 


Quantizer output 
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Figure M8.7: Transfer characteristics of an asymmetric 3-bit quantizer. 


There is no doubt that quantization can change a signal. It follows that the spectrum of a quantized signal can also change. While these 
changes are difficult to characterize mathematically, they are easy to investigate by using MATLAB. Consider a 1 Hz cosine sampled at 


f s = 50 Hz over 1 second. 
>> x = cos (2*pi*n*T); X = fft (x); 


Upon quantizing by means of a 2-bit asymmetric quantizer, both the signal and spectrum are substantially changed. 


>> xaq = MS8P1 (x, 1, 2, ‘'asym'); Xaq = fft (xaq); 

>> subplot (2, 2, 1); stem (n, x, 'k'); axis ([0 49 -1.1 1.1]); 

>> xlabel ('n'); ylabel ('x[n]'); 

>> subplot ( 2, 2); stem (f£-25, 
' 


fftshift (abs (X)), 'k'); axis ([-25, 25 -1 26]) 
>> xlabel ( ylabel ('|X(f) |"); 


2: 
>> subplot (2, 2, 3); stem (n, xaq, 'k'); axis ([0 49 -1.1 1.1]); 

>> xlabel ('n'); ylabel ('x {aq} [n]'); 

>> subplot (2, 2, 4); stem (f-25, fftshift (abs(fft (xaq))), 'k'); axis ([-25, 25 -1 26]); 
>> xlabel ('f'); ylabel ('|X {aq} (f)|'); 


The results are shown in Fig. M8.8. The original signal x[n] appears sinusoidal and has pure spectral content at +1 Hz. The 
asymmetrically quantized signal x ag[n] is significantly distorted. The corresponding magnitude spectrum |X aq (f)| is spread over a 
broad range of frequencies. 
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Figure M8.8: Signal and spectrum effects of quantization. 


[tla functionally equivalent structure can be written by using if, else if, and else statements. 


PROBLEMS 


Note In many problems, the plots of spectra are shown as functions of frequency f Hz for convenience, although we have labeled 
them as function of w as X (w), Y (Ww), etc.] 


8.1.1 Figure P8.1-1 shows Fourier spectra of signals x 4 (tf) and x 9 (f). Determine the Nyquist sampling rates for signals x 4 
(t), x 2 (t), x 4? (f), x 2° (f), and x 4 ()x 2 (d). 


Figure P81 -1 
8.1.2 Determine the Nyquist sampling rate and the Nyquist sampling interval for the signals. 
a. sinc? (100ttf) 
b. 0.01 sinc? (100Ttt) 


c. sinc(100Tr£) + 3 sinc? (60T1f) 
d. sinc(50trt) sinc (100Trf) 


a. Sketch |X (w)|, the amplitude spectrum of a signal x (f) = 3 cos 61tt + sin 18Ttt + 2 cos(28 — ¢)tTrt, 
where ¢ is a very small number — 0. Determine the minimum sampling rate required to be able to 
reconstruct x (t) from these samples. 


b. Sketch the amplitude spectrum of the sampled signal when the sampling rate is 25% above the Nyquist 
rate (show the spectrum over the frequency range +50 Hz only). How would you reconstruct x (f) from 
these samples? 


a. Derive the sampling theorem by considering the fact that the sampled signal x (ft) = x (t)87 (t), and using 
the frequency-convolution property in Eq. (7.43). 


b. For a sampling train consisting of shifted unit impulses at instants nT + T instead of at nT (for all positive 
and negative integer values of n), find the spectrum of the sampled signal. 


8.1.5 A signal is bandlimited to 12 kHz. The band between 10 and 12 kHz has been so corrupted by excessive noise that the 
information in this band is nonrecoverable. Determine the minimum sampling rate for this signal so that the uncorrupted 
portion of the band can be recovered. If we were to filter out the corrupted spectrum prior to sampling, what would be 
the minimum sampling rate? 


8.1.6 


8.1.10 


A continuous-time signal x (t) = A((t = 1)/2) is sampled at three rates: 10, 2, and 1 Hz. Sketch the resulting sampled 
signals. Because x (f) is timelimited, its bandwidth is infinite. However, most of its energy is concentrated in a small 
band. Can you determine the reasonable minimum sampling rate that will allow reconstruction of this signal with a small 
error? The answer is not unique. Make a reasonable assumption of what you define as a "negligible" or "small" error. 


a. A signal x (t) = 5 sinc? (5trt) + cos 20Ttt is sampled at a rate of 10 Hz. Find the spectrum of the sampled 
signal. Can x (t) be reconstructed by lowpass filtering the sampled signal? 


b. Repeat part (a) for a sampling frequency of 20 Hz. Can you reconstruct the signal from this sampled 
signal? Explain. 


c. If x (t) = 5 sinc? (5t1r£)+sin 20Ttt, can you reconstruct x (t) from the samples of x (tf) at a rate of 20 Hz? 
Explain your answer with spectral representations(s). 


d. For x (f)=5 sinc? (5trt) + sin 20Tf can you reconstruct x (ft) from the samples of x (tf) at a rate of 21 
Hz? Explain your answer with spectral representation(s). Comment on your results. 


a. The highest frequency in the spectrum X (w) (Fig. P8.1-8a) of a bandpass signal x (f) is 30 Hz. Hence, 
the minimum sampling frequency needed to sample x (f) is 60 Hz. Show the spectrum of the signal 
sampled at a rate of 60 Hz. Can you reconstruct x (tf) from these samples? How? 


Figure P8.1-8 


b. A certain busy student looks at X (w), concludes that its bandwidth is really 10 Hz, and decides that the 
sampling rate 20 Hz is adequate for sampling x (t). Sketch the spectrum of the signal sampled at a rate of 
20 Hz. Can she reconstruct x (tf) from these samples? 


c. The same student, using the same reasoning, looks at Y (w) in Fig. P8.1-8b, the spectrum of another 
bandpass signal y (tf), and concludes that she can use sampling rate of 20 Hz to sample y (t). Sketch the 
spectrum of the signal y (t) sampled at a rate of 20 Hz. Can she reconstruct y (t) from these samples? 


A signal x (ft) whose spectrum X (Ww), as shown in Fig. P8.1-9, is sampled at a frequency f , = f4 +f» Hz. Find all the 
sample values of x (f) merely by inspection of X (w). 


1» X(o) 
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Figure P8.1-9 


In digital data transmission over a communication channel, it is important to know the upper theoretical limit on the rate 
of digital pulses that can be transmitted over a channel of band-width B Hz. In digital transmission, the relative shape of 
the pulse is not important. We are interested in knowing only the amplitude represented by the pulse. For instance, in 
binary communication, we are interested in knowing whether the received pulse amplitude is 1 or —1 (positive or 
negative). Thus, each pulse represents one piece of information. Consider one independent amplitude value (not 
necessarily binary) as one piece of information. Show that 2B independent pieces of information per second can be 
transmitted correctly (assuming no noise) over a channel of bandwidth B Hz. This important principle in communication 
theory states that one hertz of bandwidth can transmit two independent pieces of information per second. It represents 
the upper rate of pulse transmission over a channel without any error in reception in the absence of noise. [Hint: 
According to the interpolation formula [Eq. (8.11)], a continuous-time signal of bandwidth B Hz can be constructed from 
2B pieces of information/second.] 


8.1.11 


8.2.1 


8.2.2 


8.2.3 


This example is one of those interesting situations leading to a curious result in the category of defying gravity. The sinc 
function can be recovered from its samples taken at extremely low frequencies in apparent defiance of the sampling 
theorem. 


Consider a sinc pulse x (ft) = sinc (41rf) for which X (w) = (1/4) rect (w/8Tr). The bandwidth of x (t) is B = 2Hz, and its 
Nyquist rate is 4 Hz. 


a. Sample x (t) at a rate 4 Hz and sketch the spectrum of the sampled signal. 


b. To recover x (t) from its samples, we pass the sampled signal through an ideal lowpass filter of bandwidth 
B = 2 Hzand gain G = T = 1/4. Sketch this system and show that for this system H (uw) = (1/4) rect 
(v0/8TT). Show also that when the input is the sampled x (f) at a rate 4 Hz, the output of this system is 
indeed x (tf), as expected. 


c. Now sample x (f) at half the Nyquist rate, at 2 Hz. Apply this sampled signal at the input of the lowpass 
filter used part (b). Find the output. 


d. Repeat part (c) for the sampling rate 1 Hz. 


e. Show that the output of the lowpass filter in part (b) is x (tf) to the sampled x (f) if the sampling rate is 4/N, 
where N is any positive integer. This means that we can recover x (t) from its samples taken at arbitrarily 
small rate by letting N — oo. 


f. The mystery may be clarified a bit by examining the problem in the time domain. Find the samples of x (f) 
when the sampling rate is 2/N (N integer). 


A signal x (t) = sinc (200Trf) is sampled (multiplied) by a periodic pulse train p 7 (t) represented in Fig. P8.2-1. Find 
and sketch the spectrum of the sampled signal. Explain whether you will be able to reconstruct x (ft) from these 
samples. Find the filter output if the sampled signal is passed through an ideal lowpass filter of bandwidth 100 Hz and 
unit gain. What is the filter output if its bandwidth B Hz is between 100 and 150 Hz? What happens if the bandwidth 
exceeds 150 Hz? 
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Figure P8.2-1 


Show that the circuit in Fig. P8.2-2 is a realization of the causal ZOH (zero-order hold) circuit. You can do this by 
showing that the unit impulse response h (ft) of this circuit is indeed equal to that in Eq. (8.9a) delayed by 7/2 seconds 
to make it causal. 
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Figure P8.2-2 


a. A first-order hold circuit (FOH) can also be used to reconstruct a signal x (ft) from its samples. The impulse 
response of this circuit is h (t) = A(i#/2T), where Tis the sampling interval. Consider a typical sampled 
signal x (t) and show that this circuit performs the linear interpolation. In other words, the filter output 
consists of sample tops connected by straight-line segments. Follow the procedure discussed in Section 
8.2 (Fig. 8.5c). 


b. Determine the frequency response of this filter, and its amplitude response, and compare it with 
i. the ideal filter required for signal reconstruction 
ii. the ZOH circuit 


c. This filter, being noncausal, is unrealizable. By delaying its impulse response, the filter can be made 
realizable. What is the minimum delay required to make it realizable? How would this delay affect the 
reconstructed signal and the filter frequency response? 


d. Show that the causal FOH circuit in part (c) can be realized by the ZOH circuit depicted in Fig. P8.2-2 
followed by an identical filter in cascade. 


8.2.4 


8.2.5 


8.2.6 


8.2.7 


8.2.8 


8.2.9 


In the text, for sampling purposes, we used timelimited narrow pulses such as impulses or rectangular pulses of width 
less than the sampling interval 7. Show that it is not necessary to restrict the sampling pulse width. We can use 
sampling pulses of arbitrarily large duration and still be able to reconstruct the signal x (tf) as long as the pulse rate is 
no less than the Nyquist rate for x (¢). 


Consider x (t) to be bandlimited to B Hz. The sampling pulse to be used is an exponential e~“u (t). We multiply x (t) 


by a periodic train of exponential pulses of the form e~*u (t) spaced T seconds apart. Find the spectrum of the 
sampled signal, and show that x (ft) can be reconstructed from this sampled signal provided the sampling rate is no less 
than 2B Hz or T < 1/2B. Explain how you would reconstruct x (t) from the sampled signal. 


In Example 8.2, the sampling of a signal x (t) was accomplished by multiplying the signal by a pulse train p 7 (t), 
resulting in the sampled signal depicted in Fig. 8.4d. This procedure is known as the natural sampling. Figure P8.2-5 
shows the so-called flat-top sampling of the same signal x (tf) = sinc? (5t1rf). 


0.3 0.1 0 0.2 ital 
Figure P8.2-5: Flat-top sampling. 


a. Show that the signal x (t) can be recovered from flat-top samples if the sampling rate is no less than the 
Nyquist rate. 


b. Explain how you would recover x (tf) from the flat-top samples. 

c. Find the expression for the sampled signal spectrum X (uw) and sketch it roughly. 
A sinusoid of frequency fg Hz is sampled at a rate f , = 20 Hz. Find the apparent frequency of the sampled signal if f 9 
is 

a. 8 Hz 

b. 12 Hz 

c. 20 Hz 

d. 22 Hz 

e. 32 Hz 


A sinusoid of unknown frequency f 9 is sampled at a rate 60 Hz. The apparent frequency of the samples is 20 Hz. 
Determine f 9 if it is known that f 9 lies in the range 


a. 0-30 Hz 

b. 30-60 Hz 
c. 60-90 Hz 
d. 90-120 Hz 


A signal x (t) = 3 cos 6Ttt + cos 16Ttf + 2 cos 20Ttt is sampled at a rate 25% above the Nyquist rate. Sketch the 
spectrum of the sampled signal. How would you reconstruct x (f) from these samples? If the sampling frequency is 25% 
below the Nyquist rate, what are the frequencies of the sinusoids present in the output of the filter with cutoff frequency 
equal to the folding frequency? Do not write the actual output; give just the frequencies of the sinusoids present in the 
output. 


8.2.10 


8.2.11 


8.2.12 


8.2.13 


8.2.14 


a. Show that the signal x (t), reconstructed from its samples x (nT), using Eq. (8.11a) has a bandwidth B « 
1/2T Hz. 


b. Show that x (f) is the smallest bandwidth signal that passes through samples x (nT). [Hint: Use the 
reductio ad absurdum method.] 


In digital communication systems, the efficient use of channel bandwidth is ensured by transmitting digital data encoded 
by means of bandlimited pulses. Unfortunately, bandlimited pulses are nontimelimited; that is, they have infinite duration, 
which causes pulses representing successive digits to interfere and cause errors in the reading of true pulse values. 
This difficulty can be resolved by shaping a pulse p (f) in such a way that it is bandlimited, yet causes zero interference 
at the sampling instants. To transmit R pulses per second, we require a minimum bandwidth R/2 Hz (see Prob. 8.1-10). 
The bandwidth of p (tf) should be R/2 Hz, and its samples, in order to cause no interference at all other sampling 
instants, must satisfy the condition ' 


l = = 
n=0Q T R 
nz£0 


p(aT) = 


Because the pulse rate is R pulses per second, the sampling instants are located at intervals of 1/R seconds. Hence, 
the foregoing condition ensures that any given pulse will not interfere with the amplitude of any other pulse at its center. 
Find p (t). Is p (tf) unique in the sense that no other pulse satisfies the given requirements? 


The problem of pulse interference in digital data transmission was outlined in Prob. 8.2-10, where we found a pulse 
shape p (f) to eliminate the interference. Unfortunately, the pulse found is not only noncausal, (and unrealizable) but 
also has a serious drawback: because of its slow decay (as 1/t), it is prone to severe interference due to small 
parameter deviation. To make the pulse decay rapidly, Nyquist proposed relaxing the bandwidth requirement from R/2 
Hz to kKR/2 Hz with 1 < k « 2. The pulse must still have a property of noninterference with other pulses, for example, 


1 

1 =0 T=- 
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p(aT) — 


Show that this condition is satisfied only if the pulse spectrum P (w) has an odd symmetry about the set of dotted axes 
as shown in Fig. P8.2-11. The bandwidth of P (w) is KR/2 Hz (1 < k < 2). 
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Figure P8.2-11 


The Nyquist samples of a signal x (t) bandlimited to B Hz are 
1 n=0,1 


a ie EE | Boe 


Show that _ 
sinc (27 Br) 
x(t) = ————— 
1—2Rt 
This pulse, known as the duobinary pulse, is used in digital transmission applications. 


A signal bandlimited to B Hz is sampled at a rate f , = 2B Hz. Show that 


oO ea] 
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[Hint: Use the orthogonality property of the sinc function in Prob. 7.6-5.] 


Prove that a signal cannot be simultaneously timelimited and bandlimited. [Hint: Show that contrary assumption leads to 
contradiction. Assume a signal to be simultaneously time-limited and bandlimited so that X (w) = 0 for |w| = 277B. In 


8.3.1 


8.3.2 


8.3.3 


8.3.4 


8.4.1 


8.5.1 


8.5.2 


this case X (w) = X (w)rect (w/41B’) for B’> B. This fact means that x (t) is equal to x (t) * 2B’ sinc (27TB ‘t). The 
latter cannot be timelimited because the sinc function tail extends to infinity.] 


A compact disc(CD) records audio signals digitally by means of a binary code. Assume an audio signal bandwidth of 15 
kHz. 


a. What is the Nyquist rate? 


b. If the Nyquist samples are quantized into 65,536 levels (L = 65,536) and then binary coded, what number 
of binary digits is required to encode a sample. 


c. Determine the number of binary digits per second (bits/s) required to encode the audio signal. 


d. For practical reasons discussed in the text, signals are sampled at a rate well above the Nyquist rate. 
Practical CDs use 44,100 samples/s. If L = 65,536, determine the number of pulses per second required to 
encode the signal. 


A TV signal (video and audio) has a bandwidth of 4.5 MHz. This signal is sampled, quantized, and binary coded. 
a. Determine the sampling rate if the signal is to be sampled at a rate 20% above the Nyquist rate. 


b. If the samples are quantized into 1024 levels, what number of binary pulses is required to encode each 
sample? 


c. Determine the binary pulse rate (bits/s) of the binary-coded signal. 


a. Ina certain A/D scheme, there are 16 quantization levels. give one possible binary code and one possible 
quaternary (4-ary) code. For the quaternary code use 0, 1, 2, and 3 as the four symbols. Use the minimum 
number of digits in your code. 


b. To represent a given number of quantization levels L, we require a minimum of b jy digits for an M-ary 
code. Show that the ratio of the number of digits in a binary code to the number of digits in a quaternary 
(4-ary) code is 2, that is, b 9/b 4 = 2. 


Five telemetry signals, each of bandwidth 1 kHz, are quantized and binary coded. These signals are time-division 
multiplexed (signal bits interleaved). Choose the number of quantization levels so that the maximum error in sample 
amplitudes is no greater than 0.2% of the peak signal amplitude. The signals must be sampled at least 20% above the 
Nyquist rate. Determine the data rate (bits per second) of the multiplexed signal. 


The Fourier transform of a signal x (f), bandlimited to B Hz, is X (w). The signal x (t) is repeated periodically at intervals 
T, where T = 1.25/B. The resulting signal y (¢) is 
25 


y(t) = Sox —anT) 


Show that y (f) can be expressed as 


y(t) = Co + C, cos (1.67 Br + 0) 


where 

l 
Co = 7*xO) 

2 2n 
C= — |X| — 
77) 
and 


2a 
a= LX (=) 


Recall that a bandlimited signal is not time limited, and hence has infinite duration. The periodic repetitions are all 
overlapping. 


For a signal x (ft) that is timelimited to 10 ms and has an essential bandwidth of 10 kHz, determine N 9, the number of 
signal samples necessary to compute a power-of-2 FFT with a frequency resolution f g of at least 50 Hz. Explain whether 
any zero padding is necessary. 


To compute the DFT of signal x (f) in Fig. P8.5-2, write the sequence x , (for n = 0 to Ng — 1) if the frequency 
resolution f g must be at least 0.25 Hz. Assume the essential bandwidth (the folding frequency) of x (f) to be at least 3 


Hz. Do not compute the DFT; just write the appropriate sequence x p. 


Figure P8.5-2 


8.5.3 Choose appropriate values for N 9 and T and compute the DFT of the signal e~ u (t). Use two different criteria for 


determining the effective bandwidth of e fu (t). As the bandwidth, use the frequency at which the amplitude response 
drops to 1% of its peak value (at w = 0). Next, use the 99% energy criterion for determining the bandwidth (see Example 
7.20). 


8.5.4 Repeat Prob. 8.5-3 for the signal 
? 


#4) = ——_ 
x(t) e+) 


8.5.5 For the signals x (t) and g (t) represented in Fig. P8.5-5, write the appropriate sequences x , and g , necessary for the 
computation of the convolution of x (ft) and g (tf) using DFT. Use T = 1/8. 


x(t) 


(a) 


Figure P8.5-5 


8.5.6 For this problem, interpret the N-point DFT as an N-periodic function of r. To stress this fact, we shall change the 
notation X ; to X (r). Are the following frequency domain signals valid DFTs? Answer yes or no. For each valid DFT, 
determine the size N of the DFT and whether the time-domain signal is real. 


a. X(n=j-T 

b. X (r) = sin (r/10) 

c. X (r) = sin (ttr/10) 

d. X (r) = [(1 + p/V2]" 

e. X(r)= r+) 49 where, <-> 49 denotes the modulo-N operation. 


8.m.1 MATLAB's ££t command computes the DFT of a vector x assuming the first sample occurs at time n = 0. Given that X 
= fft (x) has already been computed, derive a method to correct X to reflect an arbitrary starting time n =n o. 


8.m.2 Consider a complex signal composed of two closely spaced complex exponentials: x4[n]J= e/2™730/100 4 9/21133/100_ For 


each of the following cases, plot the length-N DFT magnitude as a function of frequency f ,, where f ; = r/N. 


a. Compute and plot the DFT of x 4[n] using 10 samples (0 < n <« 9). From the plot, can both exponentials 
be identified? Explain. 


b. Zero-pad the signal from part (a) with 490 zeros and then compute and plot the 500-point DFT. Does this 
improve the picture of the DFT? Explain. 


c. Compute and plot the DFT of x 4[n] using 100 samples (0 < n « 99). From the plot, can both 
exponentials be identified? Explain. 


d. Zero-pad the signal from part (c) with 400 zeros and then compute and plot the 500-point DFT. Does this 
improve the picture of the DFT? Explain. 


8.m.3 Repeat Prob. 8.M-2, using the complex signal x 9 [n] = e /27730/100 4 9/2t31.5/100_ 


8.m.4 — Consider a complex signal composed of a dc term and two complex exponentials: y1[n] = 1+e/™730/10049 5*@/27143/100, 
For each of the following cases, plot the length-N DFT magnitude as a function of frequency f ;, where f ,/ r/N. 


a. 


8.m.5 Repeat Prob. 8.M-4, using the complex signal y 9 [n] 


Use MATLAB to compute and plot the DFT of y 4[n] with 20 samples (0 < n « 19). From the plot, can 
the two nondc exponentials be identified? Given the amplitude relation between the two, the lower- 
frequency peak should be twice as large as the higher-frequency peak. Is this the case? Explain. 


. Zero-pad the signal from part (a) to a total length of 500. Does this improve locating the two non-dc 


exponential components? Is the lower-frequency peak twice as large as the higher-frequency peak? 
Explain. 


. MATLAB's signal processing toolbox function window allows window functions to be easily generated. 


Generate a length-20 Hanning window and apply it to y ;[n]. Using this windowed function, repeat parts (a) 
and (b). Comment on whether the window function helps or hinders the analysis. 


= 1 +e/2T1N30/1 0049. 5e J271n38/100_ 


8.m.6 This problem investigates the idea of zero padding applied in the frequency domain. When asked, plot the length-N DFT 
magnitude as a function of frequency f ,, where f ; = /N. 


a. 


In MATLAB, create a vector x that contains one period of the sinusoid x[n] = cos((tt/2)n). Plot the result. 
How "sinusoidal" does the signal appear? 


. Use the f££t command to compute the DFT xX of vector x. Plot the magnitude of the DFT coefficients. Do 


they make sense? 


. Zero-pad the DFT vector to a total length of 100 by inserting the appropriate number of zeros in the middle 


of the vector x. Call this zero-padded DFT sequence y. Why are zeros inserted in the middle rather than 
the end? Take the inverse DFT of Y and plot the result. What similarities exist between the new signal y 
and the original signal x? What are the differences between x and y? What is the effect of zero padding in 
the frequency domain? How is this type of zero padding similar to zero padding in the time domain? 


. Derive a general modification to the procedure of zero padding in the frequency domain to ensure that the 


amplitude of the resulting time-domain signal is left unchanged. 


. Consider one period of a square wave described by the length-8 vector [1 111 —1—1—1 —1]. Zero-pad 


the DFT of this vector to a length of 100, and call the result S. Scale S according to part (d), take the 
inverse DFT, and plot the result. Does the new time-domain signal s[n] look like a square wave? Explain. 


Chapter 9: Fourier Analysis of Discrete-Time Signals 


In Chapters 6 and 7, we studied the ways of representing a continuous-time signal as a sum of sinusoids or exponentials. In this 
chapter we shall discuss similar development for discrete-time signals. Our approach is parallel to that used for continuous-time signals. 
We first represent a periodic x[n] as a Fourier series formed by a discrete-time exponential (or sinusoid) and its harmonics. Later we 
extend this representation to an aperiodic signal x[n] by considering x[n] as a limiting case of a periodic signal with the period 
approaching infinity. 


9.1 DISCRETE-TIME FOURIER SERIES (DTFS) 


A continuous-time sinusoid cos wit is a periodic signal regardless of the value of w. Such is not the case for the discrete-time sinusoid 
cos On (or exponential fn). A sinusoid cos Qn is periodic only if Q/2tTr is a rational number. This can be proved by observing that if 
this sinusoid is No periodic, then 

cos 2(n + No) = cos Qn 

This is possible only if 

QNo = 207m m integer 


Here, both m and No are integers. Hence, 0/2Tt = m/No is a rational number. Thus, a sinusoid cos On (or exponential ef ny is periodic 
only if 


Q m : 
—_—=— a rational number (9.1a) 
2x No 
When this condition (Q/2tr a rational number) is satisfied, the period No of the sinusoid cos Qn is given by [Eq. (9.1a)] 
2x 
No =m (= (9.1b) 
Q 


To compute No, we must choose the smallest value of m that will make m(2Tt/Q) an integer. For example, if Q = 411/17, then the 
smallest value of m that will make m(21t/Q) = m (17/2) an integer is 2. Therefore 


2 17 
No =m (=) = (Z) =17 


= 


However, a sinusoid cos(0.87) is not a periodic signal because 0.8/2Tt is not a rational number. 


9.1-1 Periodic Signal Representation by Discrete-time Fourier Series 


A continuous-time periodic signal of period Tg can be represented as a trigonometric Fourier series consisting of a sinusoid of the 


fundamental frequency Wo = 2Tt/Tg, and all its harmonics. The exponential form of the Fourier series consists of exponentials elt 
etiwot ot/2w0t o+/3?0t _ 


A discrete-time periodic signal can be represented by a discrete-time Fourier series using a parallel development. Recall that a periodic 
signal x[n] with period No is characterized by the fact that 


x[n] = x[n + No] (9.2) 


The smallest value of No for which this equation holds is the fundamental period. The fundamental frequency is Qg ... 2Tt/No 
rad/sample. An No-periodic signal x[n] can be represented by a discrete-time Fourier series made up of sinusoids of fundamental 
frequency Og <= 211/Nog and its harmonics. As in the continuous-time case, we may use a trigonometric or an exponential form of the 
Fourier series. Because of its compactness and ease of mathematical manipulations, the exponential form is preferable to the 
trigonometric. For this reason we shall bypass the trigonometric form and go directly to the exponential form of the discrete-time Fourier 
series. 

The exponential Fourier series consists of the exponentials e/9”, eVQ0n _t/200n  @tin00n | and so on. There would be an infinite 
number of harmonics, except for the property proved in Section 5.5-1, that discrete-time exponentials whose frequencies are separated 
by 2Tt (or integer multiples of 2Tr) are identical because 

ef (Q4L2am)n = ei fn ptiamn = eit m integer 


The consequence of this result is that the rth harmonic is identical to the (r + Ng)th harmonic. To demonstrate this, let g, denote the 


nth harmonic e/?’"097_ Then 
i (r4+-No)Qon Hr Qpot+2arn) ir Qon 
Benny a= CLO NUGN  ol iter = el" — 9, 


and 


8r = Br+No = Br+2No = *** = Br+mNo m integer (9,3) 


Thus, the first harmonic is identical to the (No + 1)st harmonic, the second harmonic is identical to the (Nog + 2)nd harmonic, and so on. 
In other words, there are only No independent harmonics, and their frequencies range over an interval 2Tt (because the harmonics are 
separated by Og = 2Tt/Ng). This means, unlike the continuous-time counterpart, that the discrete-time Fourier series has only a finite 
number (No) of terms. This result is consistent with our observation in Section 5.5-1 that all discrete-time signals are bandlimited to a 
band from —Tr to Tr. Because the harmonics are separated by Qg = 2T1/No, there can only be No harmonics in this band. We also saw 
that this band can be taken from 0 to 2Tr or any other contiguous band of width 2tTr. This means we may choose the No independent 


harmonics e!©9" over 0 < r< No — 1, or over —1 < r< No — 2, or over 1 < r < No, or over any other suitable choice for that 
matter. Every one of these sets will have the same harmonics, although in different order. 


Let us consider the first choice, which corresponds to exponentials elt00n for r = 0,1,2...., No — 1. The Fourier series for an Ng-periodic 
signal x[n] consists of only these Ng harmonics, and can be expressed as 
No-! 4 
F , 20 
x[n] = > D,@!"Son 2 = No (9.4) 


r= 


To compute coefficients D, in the Fourier series (9.4), we multiply both sides of (9.4) by e/mQ0N and sum over n from n = 0 to (No — 


1). 


No-1 No—1 No-1 
>. alnje™™ = > > Dy elem im (9.5) 
not) nat) rent) 


The right-hand sum, after interchanging the order of summation, results in 


No-1 ‘No—1 
SD D, pas el (r—m)Qon (9.6) 
r-0 na-0 


The inner sum, according to Eq. (8.28) in Section 8.5, is zero for all values of r + m. It is nonzero with a value No only when r= m. 
This fact means the outside sum has only one term D,,No (corresponding to r = m). Therefore, the right-hand side of Eq. (9.5) is equal 


to DmNo, and 
No-1 
iD xin je~ imho = DyNo 
a=) 
and 
No-1I 
D,=— >i x[nje~/™*~" (9.7) 


0 n=0 


We now have a discrete-time Fourier series (DTFS) representation of an Ng-periodic signal x[n] as 


io—1 


xinh= > Deo (9.8) 
where 
= 2 
D, = So xinje"™" y= a (9.9) 


Observe that DTFS equations (9.8) and (9.9) are identical (within a scaling constant) to the DFT equations (8.22b) and (8.22a).!1] 
Therefore, we can use the efficient FFT algorithm to compute the DTFS coefficients. 


9.1-2 Fourier Spectra of a Periodic Signal x[n] 


The Fourier series consists of No components 
sa irae sa 
Do, D, ef", Deion | eee Dyy pei No T)Sion 


The frequencies of these components are 0, Og, 209, ..., (Ng — 1)Q9 where Oo = 211/Ng. The amount of the rth harmonic is D,.. We 


can plot this amount D, (the Fourier coefficient) as a function of index r or frequency Q. Such a plot, called the Fourier spectrum of 
x[n], gives us, at a glance, the graphical picture of the amounts of various harmonics of x[n]. 


In general, the Fourier coefficients D, are complex, and they can be represented in the polar form as 
D, = |D, |eit?r (9.10) 


The plot of |D, versus Q is called the amplitude spectrum and that of LD, versus Q is called the angle (or phase) spectrum. These 
two plots together are the frequency spectra of x[n]. Knowing these spectra, we can reconstruct or synthesize x[n] according to Eq. 
(9.8). Therefore, the Fourier (or frequency) spectra, which are an alternative way of describing a periodic signal x[n], are in every way 
equivalent (in terms of the information) to the plot of x[n] as a function of n. The Fourier spectra of a signal constitute the frequency- 
domain description of x[n], in contrast to the time-domain description, where x[n] is specified as a function of index n (representing 
time). 


The results are very similar to the representation of a continuous-time periodic signal by an exponential Fourier series except that, 
generally, the continuous-time signal spectrum bandwidth is infinite and consists of an infinite number of exponential components 
(harmonics). The spectrum of the discrete-time periodic signal, in contrast, is bandlimited and has at most Ng components. 


PERIODIC EXTENSION OF FOURIER SPECTRUM 
We now show that if ®[r] is an Ng-periodic function of r, then 


No-1 
S> ¢irl= So tr] (9.11) 
r=0 r=(No) 


where r= No) indicates summation over any No consecutive values of r. Because %[r] is No periodic, the same values repeat with 
period No. Hence, the sum of any set of No consecutive values of ®[r] must be the same no matter the value of r at which we start 
summing. Basically it represents the sum over one cycle. 


To apply this result to the DTFS, we observe that e/'@0n 


git 2oin + No) —jrQon g—jrar —jrQon 


is No periodic because 
= & = & 
Therefore, if x[n] is Ng periodic, x[nJe" 20" is also No periodic. Hence, from Eq. (9.9) it follows that D, is also No periodic, as is 


D,el"0n_ Now, because of the property (9.11), we can express Eqs. (9.8) and (9.9) as 


x[a] = > D, elton (9.12) 
r=(No} 
and 
lo eo 
D,==<- >. xine (9.13) 
9 n=(No) 


If we plot D, for all values of r (rather than only 0 < r < No — 1), then the spectrum Dz is No periodic. Moreover, Eq. (9.12) shows that 
X[n] can be synthesized by not only the Ng exponentials corresponding to 0 < r < No — 1, but by any successive No exponentials in 


this spectrum, starting at any value of r (positive or negative). For this reason, it is customary to show the spectrum D, for all values of 
r (not just over the interval 0 < r < No — 1). Yet we must remember that to synthesize x[n] from this spectrum, we need to add only No 
consecutive components. All these observations are consistent with our discussion in Chapter 5, where we showed that a sinusoid of a 
given frequency is equivalent to multitudes of sinusoids, all separated by integer multiple of 211 in frequency. 


Along the © scale, D, repeats every 2Tr intervals, and along the r scale, D, repeats at intervals of No. Equations (9.12) and (9.13) 
show that both x[n] and its spectrum D, are No periodic and both have exactly the same number of components (No) over one period. 


Equation (9.13) shows that Dz is complex in general, and D_, is the conjugate of D, if X[n] is real. Thus 
|D,| = |D_,| and LD, aa —LD_, (9.14) 


so that the amplitude spectrum |D,| is an even function, and LD, is an odd function of r (or Q). All these concepts will be clarified by 
the examples to follow. The first example is rather trivial and serves mainly to familiarize the reader with the basic concepts of DTFS. 


EXAMPLE 9.1 
Find the discrete-time Fourier series (DTFS) for x[n] = sin 0.1 Tn (Fig. 9.1a). Sketch the amplitude and phase spectra. 


xin} 
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Figure 9.1: Discrete-time sinusoid sin 0.11 n and its Fourier spectra. 


In this case the sinusoid sin 0.1 tTrn is periodic because Q/2Tt = 1/20 is a rational number and the period No is [see Eq. (9.1b)] 


2x 20 
N=m (=) =m (=) = 20m 


The smallest value of m that makes 20m an integer is m = 1. Therefore, the period No = 20, so that Og = 2Tt/No = 0.1 Tr, and from Eq. 
(9.12) 


x[n] = a Deh 


r=(20) 


where the sum is performed over any 20 consecutive values of r. We shall select the range —10 < r< 10 (values of r from —10 to 9). 
This choice corresponds to synthesizing x[n] using the spectral components in the fundamental frequency range (— <O<rtr). Thus, 
9 


xfn)= > Dye 


r=-10 


where, 7 he to Eq. (9.13), 


D, =— 1 5 sin 0. 12n e~7°'™™ 
= 10 
Lua I , 
sce m7 Y, — (eI9-lxn — e7f0.1x0 ye JO.lxra 
a= 10 J 
l 9 9 
= a eld.lan(l—r) _ oy e70-lan(l+r) 
40) a=—10 a=—10 


In these sums, r takes on all values between —10 and 9. From Eq. (8.28) it follows that the first sum on the right-hand side is zero for 
all values of r except r= 1, when the sum is equal to No = 20. Similarly, the second sum is zero for all values of r except r= —1, when 
it is equal to No = 20. Therefore 


dD, =-—_ and D_, — 
J 
and all other coefficients are zero. The corresponding Fourier series is given by 


] j 
x[n] = sin 0.120 = Ti — @ Mine) (9.15) 


Here the fundamental frequency Qg = 0.111, and there are only two nonzero components: 


2j 2 
i _ 1 in/2 
ee OU 
Therefore 
1 
Dy] = |Da| = 5 


5 
LD, =- >= and LD 1= 


NA 


Sketches of DP, for the interval (—10 < r< 10) appear in Fig. 9.1b and 9.1c. According to Eq. (9.15), there are only two components 
corresponding to r= 1 and —1. The remaining 18 coefficients are zero. The rth component D, is the amplitude of the frequency rOg = 
0.1rtt. Therefore, the frequency interval corresponding to —10 < r< 10 is —™<<mTT, as depicted in Fig. 9.1b and 9.1c. This spectrum 
over the range —10 < r< 10 (or —Tr) is sufficient to specify the frequency-domain description (Fourier series), and we can synthesize 
x[n] by adding these spectral components. Because of the periodicity property discussed in Section 9.1-2, the spectrum Deis a periodic 
function of r with period Ng = 20. For this reason, we repeat the spectrum with period No = 20 (or O = 2m), as illustrated in Fig. 9.1b 
and 9.1c, which are periodic extensions of the spectrum in the range —10 < r< 10. Observe that the amplitude spectrum is an even 
function and the angle or phase spectrum is an odd function of r (or O) as expected. 


The result (9.15) is a trigonometric identity and could have been obtained immediately without the formality of finding the Fourier 
coefficients. We have intentionally chosen this trivial example to introduce the reader gently to the new concept of the discrete-time 
Fourier series and its periodic nature. The Fourier series is a way of expressing a periodic signal x[n] in terms of exponentials of the 
form e/@07 and its harmonics. The result in Eq. (9.15) is merely a statement of the (obvious) fact that sin 0.11 n can be expressed as 
a sum of two exponentials e/9-17™ and e/0-1717 


Because of the periodicity of the discrete-time exponentials elf20n | the Fourier series components can be selected in any range of 
length No = 20 (or O = 2tTr). For example, if we select the frequency range 0 < QO < 271 (or 0 < r< 20), we obtain the Fourier series as 


l - ‘ 
x[n] = sin 0.120 = The Inn _ @fldnny (9.16) 


This series is equivalent to that in Eq. (9.15) because the two exponentials e/1-9™ and e/-9-1™ are equivalent. This follows from the 
fact that 1-977 =e/1.9T1 yx g-/2TIN = g-jOTN 


We could have selected the spectrum over any other range of width O = 2tTr in Fig. 9.1b and 9.1c as a valid discrete-time Fourier 
series. The reader may verify this by proving that such a spectrum starting anywhere (and of width Q = 211) is equivalent to the same 
two components on the right-hand side of Eq. (9.15). 


EXERCISE E9.1 


From the spectra in Fig. 9.1 write the Fourier series corresponding to the interval —10 > r > —30 (or—Tr=>Q>—3rr). Show that this 
Fourier is equivalent to that in Eq. (9.15). 


EXERCISE E9.2 


Find the period and the DTFS for BF 
x[n] = 4cos 0.272 + 6sin0.5a7n . 


over the interval O < r < 19. Use Eq. (9.9) to compute D,. 
Answers 


No = 20 
x[n] = 2 ei0.dan rs (3¢e7 47/2) ei0.5an + (3e/*/2 jell San + 2¢e/) &xn 


EXERCISE E9.3 


Find the fundamental periods No, if any, for the following sinusoids. BF 


a. sin(301111n/4) 


b. cos 1.3n 


Answers 


b. No does not exist because the sinusoid is not periodic. 


EXAMPLE 9.2 
Find the discrete-time Fourier series for the periodic sampled gate function shown in Fig. 9.2a. 
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Figure 9.2: (a) Periodic sampled gate pulse and (b) its Fourier spectrum. 


In this case No = 32 and Og = 271/32 = 11/16. Therefore 


xin)= 5° Deh (9.17) 
r=({32) 
where 
1 : 
D, = 7 x[nJe eon (9.18a) 
n=(32) 


For our convenience, we shall choose the interval —16 < n < 15 for the summation (9.18a), although any other interval of the same 
width (32 points) would give the same result.!T] 
15 


1 ; 
peas > sine 
32 
n= 16 
Now x[n] = 1 for —4 <n < 4 and is zero for all other values of n. Therefore 
1 a 
D paagrae ea it (a/16\n (9.18b) 

3924 


This is a geometric progression with a common ratio e/(7/16)" Therefore [see Sec. (B.7-4)], 


1 e jGSar/i6) ef Anr/16) 
pts 32 e-Har/s) 4 


l1\e JOSar flo le JAS {16 elASar/io) 
= (=) @7 J (0.5a1 18) [e~ J OS27/16) "= ei @Sar/16)) 


D, 


I \ sin (4.57rQ») a 
Pd ser) cc Selenite NM = — 9.19 
(=) sin (0.5rQ») 16 a 


This spectrum (with its periodic extension) is depicted in Fig. 9.2b.!1] 


COMPUTER EXAMPLE C9.1 
Repeat Example 9.2 using MATLAB. 


>> NO = 32; n = (0: N O-1); 

>> x n = [ones(1,5) zeros(1,23) ones(1,4)]; 

>> for © = 0331; 

>> X r(r+l) = sum(x n.*exp(-j*r*2*pi/N O*n) ) /32; 
>> end i - 7 

>> subplot (2,1,1); r = n; stem (r,real(X_r),'k"'); 

>> xlable('r'); ylabel('X r'); axis([0 31 -.1 0.3]); 


eS 
>> 


legend('DTFS by direct computation',0O); 
X vr = fft(x n)/N 0; 


>> 
>> 
>> 


03 ‘ 


subplot (2,17,2); 
xlabel('x'); 
legend('DTFS by FFT',0); 


stem(r,real(X r), 
ylabel('X r'); 


axis 


k! 
([0 


); 
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Figure C9.1 
[tlif we let x[n] = Nox, and P, = x,, Eqs. (9.8) and (9.9) are identical to Eqs. (8.22b) and (8.22a), respectively. 


[Tin this example we have used the same equations as those for DFT in Example 8.9, within a scaling constant. In the present 
example, the values of x[n] at n = 4 and —4 are taken as 1 (full value), whereas in Example 8.9 these values are 0.5 (half the value). 
This is the reason for the slight difference in spectra in Fig. 9.2b and Fig. 8.18d. Unlike continuous-time signals, discontinuity is a 
meaningless concept in discrete-time signals. 


[t] Strictly speaking, geometric progression sum formula applies only if the common ratio eW U(m/16)r = 4. When r= O, this ratio is unity. 
Hence, Eq. (9.19) is valid for values of r + 0. For the case r= 0, the sum in Eq. (9.18b) is given by 


Fortunately, the value of Dg, as computed from Eq. (9.19) also happens to be 9/32. Hence, Eq. (9.19) is valid for all r. 


9.2 APERIODIC SIGNAL REPRESENTATION BY FOURIER INTEGRAL 


In Section 9.1 we succeeded in representing periodic signals as a sum of (everlasting) exponentials. In this section we extend this 
representation to aperiodic signals. The procedure is identical conceptually to that used in Chapter 7 for continuous-time signals. 


Applying a limiting process, we now show that an aperiodic signal x[n] can be expressed as a continuous sum (integral) of everlasting 
exponentials. To represent an aperiodic signal x[n] such as the one illustrated in Fig. 9.3a by everlasting exponential signals, let us 
construct a new periodic signal xjg[n] formed by repeating the signal x[n] every No units, as shown in 


lll 
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Figure 9.3: Generation of a periodic signal by periodic extension of a signal x[n]. 


Fig. 9.3b. The period No is made large enough to avoid overlap between the repeating cycles (No => 2N + 1). The periodic signal 
Xno[n] can be represented by an exponential Fourier series. If we let Ng —, the signal x[n] repeats after an infinite interval, and 
therefore 

lim xy,[7] = x[n] 
Na-+oo 


Thus, the Fourier series representing xjyo[n] will also represent x[n] in the limit Ng — oo. The exponential Fourier series for x;yo [Nn] is 
given by 


, 2x 
SN = D,e"™" Q = — 9.20 
Xwoln] y e 7 (9.20) 
where 
l ~ 
D,=— x[n]e"**" (9.21) 


No, 


The limits for the sum on the right-hand side of Eq. (9.21) should be from — N to N. But because x[n] = 0 for |n| > N, it does not matter 
if the limits are taken from — oo to o. 


=—m© 


It is interesting to see how the nature of the spectrum changes as Nog increases. To understand this behavior, let us define X(Q), a 
continuous function of O, as 


X(Q)= S> x[nje~i™ (9.22) 


From this definition and Eq. (9.21), we have 


| 
D, = —X(rQ) (9.23) 
No 
This result shows that the Fourier coefficients DP, are 1/No times the samples of X(Q) taken every Qo rad/s.!t] Therefore, (1/No)X(Q) is 


the envelope for the coefficients D,. We now let No — © by doubling No repeatedly. Doubling Ng halves the fundamental frequency 
Qo, with the result that the spacing between successive spectral components (harmonics) is halved, and there are now twice as many 


components (samples) in the spectrum. At the same time, by doubling No, the envelope of the coefficients Dis halved, as seen from 
Eq. (9.23). If we continue this process of doubling No repeatedly, the number of components doubles in each step; the spectrum 
progressively becomes denser while its magnitude D, becomes smaller. Note, however, that the relative shape of the envelope remains 
the same [proportional to X (QO) in Eq. (9.22)]. In the limit, as Ng — oo, the fundamental frequency Og — 0, and D, — 0. The separation 
between successive harmonics, which is Qo, is approaching zero (infinitesimal), and the spectrum becomes so dense that it appears to 


be continuous. But as the number of harmonics increases indefinitely, the harmonic amplitudes D, become vanishingly small 
(infinitesimal). We discussed an identical situation in Section 7.1. 
We follow the procedure in Section 7.1 and let Ng — 0. According to Eq. (9.22) 


oO 


X(rQo) = >. x[nJe 7" (9.24) 


a= OOo 


Using Eqs. (9.23), we can express Eq. (9.20) as, 


1 
Xn [n] — N. a: X(rQo)e"™" (9.25a) 


) 
‘ ra iNo) 


ir Od Q¢ 
= >» X(rQo)e"**™" (>) (9,25b) 


r={No) 


In the limit as Ng +00 g Q= 0 and xno [n] — x[n]. Therefore 


B eee X (FQ) 2 
x[n] = dim, pe a 


| efron (9.26) 
2x 
raiNo) 


Because Q is infinitesimal, it will be appropriate to replace Qo with an infinitesimal notation AQ: 


co 927 
-= (9.27) 


Equation (9.26) can be expressed as 


Lo AQ 
, ae | pic pit As 92? 
x[n] Jim, a ey X(rAQ)e AQ (9.28) 
The range r= No) implies the interval of No number of harmonics, which is No AQ = 211 according to Eq. (9.27). In the limit, the 
right-hand side of Eq. (9.28) becomes the integral 


” 
x[n] = = | X(Q)e!"™" dQ (9.29) 


where J, indicates integration over any continuous interval of 21. The spectrum X(Q) is given by [Eq. (9.22)] 


oo 
X(Q) = a x[nje"/™ (9,30) 
A=—oO 
The integral on the right-hand side of Eq. (9.29) is called the Fourier integral. We have now succeeded in representing an aperiodic 
signal x[n] by a Fourier integral (rather than a Fourier series). This integral is basically a Fourier series (in the limit) with fundamental 


frequency A-— 0, as seen in Eq. (9.28). The amount of the exponential elAQn ig X(r AQ)A/2tr. Thus, the function X(Q) given by Eq. 
(9.30) acts as a spectral function, which indicates the relative amounts of various exponential components of x[n]. 


We call X(Q) the (direct) discrete-time Fourier transform (DTFT) of x[n], and x[n] the inverse discrete-time Fourier transform (IDTFT) of 
X(Q). This nomenclature can be represented as 


X(Q) = DTFT{x[n]} and x[n] = IDTFT{X(Q)} 
The same information is conveyed by the statement that x[n] and X(Q) are a (discrete-time) Fourier transform pair. Symbolically, this is 
expressed as 


x[n] => X(Q) 


The Fourier transform X(Q) is the frequency-domain description of x[n]. 


9.2-1 Nature of Fourier Spectra 


We now discuss several important features of the discrete-time Fourier transform and the spectra associated with it. 


THE FOURIER SPECTRA ARE CONTINUOUS FUNCTIONS OF © 
Although x[n] is a discrete-time signal, X(Q), its DTFT is a continuous function of Q for the simple reason that O is a continuous 
variable, which can take any value over a continuous interval from — oo to oo. 


THE FOURIER SPECTRA ARE PERIODIC FUNCTIONS OF © WITH PERIOD 2tr 
From Eq. (9.30) it follows that 

X(Q +27) = + x{nje i = SB x[{nje*™e 7" = X(Q) (9.31) 
Clearly, the spectrum X(Q) is a continuous, periodic function of Q with period 2Tr. We must remember, however, that to synthesize 
X[n], we need to use the spectrum over a frequency interval of only 2Tr, starting at any value of O [see Eq. (9.29)]. As a matter of 
convenience, we shall choose this interval to be the fundamental frequency range (—TITT,). It is, therefore, not necessary to show 


discrete-time -signal spectra beyond the fundamental range, although we often do so. 


The reason for periodic behavior of X(Q) was discussed in Chapter 5, where we showed that, in a basic sense, the discrete-time 
frequency Q is bandlimited to |O|=tt. However, all discrete-time sinusoids with frequencies separated by an integer multiple of 21 are 
identical. This is why the spectrum is 2Tt periodic. 
CONJUGATE SYMMETRY OF X(Q) 
From Eq. (9.30), we obtain the DTFT of x [n] as 
x 
DTFT{x"[n]) = S> x"[nje™ = x*(-2) (9,32a) 


aa—%O 


In other words, 


x*[n] —> X*(-Q) (9.32b) 
For real x[n], Eq. (9.32b) reduces to x[n] = X'(-), which implies that for real x[n] 
X(Q) = X*(-Q) 


Therefore, for real x[n], X(Q.) and X(—Q) are conjugates. Since X(Q) is generally complex, we have both amplitude and angle (or 
phase) spectra 


X(Q) = |X(Q)e/*O 

Because of conjugate symmetry of X(Q), it follows that for real x[n] 

|X (2)| = |[X(—2)| 

£X(Q) = —£X(—-Q) 

Therefore, the amplitude spectrum |X(Q)| is an even function of O and the phase spectrum L_X(Q) is an odd function of © for real x[n]. 
PHYSICAL APPRECIATION OF THE DISCRETE-TIME FOURIER TRANSFORM 

In understanding any aspect of the Fourier transform, we should remember that Fourier representation is a way of expressing a signal 


X[n] as a sum of everlasting exponentials (or sinusoids). The Fourier spectrum of a signal indicates the relative amplitudes and phases 
of the exponentials (or sinusoids) required to synthesize x[n]. 


A detailed explanation of the nature of such sums over a continuum of frequencies is provided in Section 7.1-1. 
EXISTENCE OF THE DTFT 
Because je 7On| = 1, from Eq. (9.30), it follows that the existence of X(Q) is guaranteed if x[n] is absolutely summable: that is, 


> |x[n]| < oo (9,33a) 


a=—OO 


This shows that the condition of absolute summability is a sufficient condition for the existence of the DTFT representation. This 
condition also guarantees its uniform convergence. The inequality 
* 2 ‘ 
oO oo 


5 
S> Ixtall| = SS ixtall 

An=—O0O a=—OO 

shows that the energy of an absolutely summable sequence is finite. However, not all finite-energy signals are absolutely summable. 

Signal x[n] = sinc (n) is such an example. For such signals, the DTFT converges, not uniformly, but in the mean. lt] 


To summarize, X(Q) exists under a weaker condition 


~ 
35 Ixtn]|? < 00 (9.33b) 


a=—Oo 


The DTFT under this condition is guaranteed to converge in the mean. Thus, the DTFT of the exponentially growing signal y"u[n] does 
not exist when |y|> 1 because the signal violates conditions (9.33a) and (9.33b). But the DTFT exists for the signal sinc(n), which 

violates (9.33a) but does satisfy (9.33b) (see later: Example 9.6). In addition, if the use of y(Q), the continuous-time impulse function, is 
permitted, we can even find the DTFT of some signals that violate both (9.33a) and (9.33b). Such signals are not absolutely summable, 


nor do they have finite energy. For example, as seen from pairs 11 and 12 of Table 9.1, the DTFT of x[n] = 1 for all n and x[n] = QlQon 
exist, although they violate conditions (9.33a) and (9.33b). 


Table 9.1: A Short Table of Discrete-Time Fourier Transforms 


= Open table as spreadsheet 
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k=—co 
cos Qgn) u[n ef2 _ @lf . 
(cos Qon) u[n] —— re a Lae- ak — QW) + 5(Q— Wk + QM) 
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sin Qon) u[n /2 sin Q = 
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EXAMPLE 9.3 


Find the ailalg of x[n] = y” u[n]. 


X(Q) = 


This is an infinite geometric series with a common ratio ye 


X(Q) 


St 
~ Sve" 
n=0 


JQ. Therefore (see Section B.7-4) 


1—yei® 


provided that |ye |< 1.But because |e |= 1, this condition implies |y| < 1. Therefore 


1 
If ly] > 1, X (Q) does not converge. This result is in conformity with condition (9.33). From Eq. (9.34a) 
1 
X(Q) = ——_——_——_——_~ 9.34b 
(82) I1—ycosQ + jy sinQ ( ) 
so that 
1 
|X (S2)| = yoann (9.35a) 
(1 — y cos £2)* + (y sin Q)* 
= I 
~ Ji +y? —2y cosQ 
£X(9) = tan! | 2) (9.350) 
l1—ycosQ 


Figure 9.4 shows x[n] = y” u[n] and its spectra for y = 0.8. Observe that the frequency spectra are continuous and periodic functions of 
Q with the period 21r. As explained earlier, we need to use the spectrum only over the frequency interval of 211. We often select this 
interval to be the fundamental frequency range (—TT,TT). 
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Figure 9.4: Exponential y” u[n] and its frequency spectra. 


The amplitude spectrum |X(Q)| is an even function and the phase spectrum L X(Q) is an odd function of OQ. 


EXAMPLE 9.4 
Find the DTFT of y” u[—(n + 1)] depicted in Fig. 9.5. 
y" u[—(n + 1)) x[n] 
oo ¢@ ¢ Peal | | | ae SE) Seo eee 
10 0 


$ n ~ 


Figure 9.5: Exponential y"u[—(n + 1)]. 


o =—oo -& l a 
X(Q) = DP y*ul-(n + De = Fi (ve Hy" = bo ue 


aAa=oo nam! aa~! 


Setting n = —m yields 


~ l 2 . l js I 82 ; l je r 
x{n]= >> —e’ =F +{—e"] +[—e"] +--: 


at=1t Y Y Y 


This is a geometric series with a common ratio elQyy, Therefore, from Section B.7-4, 


l 
_ 1 
~ (ycosQ— 1) — jy sin 
Therefore 
I 
|X(Q)| = ———————— 
V1+y?—2ycosQ 
sin Q 


Except for the change of sign, this Fourier transform (and the corresponding frequency spectra) is identical to that of x[n] = y"u[n]. Yet 
there is no ambiguity in determining the IDTFT of X(Q) = 1/(ye we —1) because of the restrictions on the value of y in each case. If 
ly|< 1, then the inverse transform is x[n] = —y” u[n]. If |y| > 1, it is x[n] = y"[—(n + 1)]. 


EXAMPLE 9.5 


Find the DTFT of the discrete-time rectangular pulse illustrated in Fig. 9.6a. This pulse is also known as the 9-point rectangular window 
function. 


anv] 


Jit. 
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Figure 9.6: (a) Discrete-time gate pulse and (b) its Fourier spectrum. 


~ 
X(Q) = > x[nje~™ 


a=—-0O 
(M—1)/2 

= bi (e/#%)" M=9 (9.38) 
nm ~(M-1)/2 


This is a geometric progression with a common ratio e J2 and (see Section B.7-4) 


oe = H/BQ _ ef (M-)/2a 


X(Q) = aed 
e i2/2(¢ H(M/DQ — ei (M/22) 
~~ p=Ja/2(e-Ia/2 — eif/2) 
M 
a 9.39 
sin (0.52) ae 
sin (4.522) 
eee: ie ais (9.40) 


~ gin (0.5Q) 


Figure 9.6b shows the spectrum X(Q) for M = 9. 


COMPUTER EXAMPLE C9.2 
Repeat Example 9.5 using MATLAB. 


>> syms Omega n M 
>> X = simplify (symsum (exp (-j*Omega*n) ,n, -(M-1)/2, (M-1)/2) ) 
xX = 
1/ (-1+exp (i*Omega) ) * (-exp (-1/2*i*Omega* (M-1) )+exp (1/2*i*Omega* (M+1) ) ) 
% Evaluate symbolic expression X(Omega) for M = 9: 
>> Omega = linspace(-pi,pi,1000); M = 9*ones(size(Omega)); X = subs (X); 
>> subplot(2,1,1); plot(Omega,abs(X),'k'); axis([-pi pi 0 9]); 
>> xlabel('\Omega'); ylabel('X(\Omega) '); 
>> legend('DTFT by symbolic computation',0O); 
% Compute samples of X(Omega) using the FFT: 
N . 


>> = 512; M= 9; 
>> x = [ones(1, (M+1)/2) zeros(1,N-M) ones(1, (M-1)/2)]; 
>> = fft(x); Omega = (-N/2:N/2-1) *2*pi/N; 


x 
>> subplot(2,1,2); plot (Omega, fftshift(abs(X)),'k.'); axis([-pi pi 0 9]); 
>> xlabel('\Omega'); ylabel('X(\Omega)'); 


>> legend('DTFT samples by FFT',0); 
DTFT by symbolic 
computation 


xi) 


} / \ 4 |- DIFT samples by FFT 


; 
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\ 
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Figure C9.2 


EXAMPLE 9.6 
Find the inverse DTFT of the rectangular pulse spectrum described over the fundamental band (|Q| <tr) by X(Q) = rect (0/20) for OQ, 
<tr. Because of the periodicity property, X(Q) repeats at the intervals of 211, as shown in Fig. 9.7a. 
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Figure 9.7: Inverse discrete-time Fourier transform of a periodic gate spectrum. 


Cd 


According to Eq. (9.29) 


“ . Ry 
x[n] = al X(Q)e"** dQ = al ce dQ 
28: Six 2n J a, 


1 th 


=——e 


_ sin(Qn)  Q. 
 j2xn 7 7 


jad — sine (Q.n) (941) 


Re aun 


The signal x[n] is depicted in Fig. 9.7b (for the case O, = Tr/4). 


EXERCISE E9.4 


Find and sketch the amplitude and phase spectra of the DTFT of the signal x[n] = ylAl with |y| | 1. ? 


Answers 


a] 


l-—y* 


X(Q) = ——————— 
1—2ycos 2+ y* 


EXERCISE E9.5 


Find and sketch the amplitude and phase spectra of the DTFT of the signal x[n] = 8[n + 1] — 8[n — 1]. = 


Answers 
|X (Q)| = 2| sin Q| 
£X(w) = (2 /2)[1 — sgn (sin 2)] 


9.2.2 Connection Between the DTFT and the z-Transform 


The connection between the (bilateral) -transform and the DTFT is similar to that between the Laplace transform and the Fourier 
transform. The -transform of x[n], according to Eq. (5.1) is 


oo 
A(z] = >. x[n]z" (9.42a) 
n=—00 
Setting = e/2 in this equation yields 
oo 
Xe] = >> x[n]e™ (9.42b) 
n=—co 
The right-hand side sum defines X(Q), the DTFT of x[n]. Does this mean that the DTFT can be obtained from the corresponding - 
transform by setting = e/2? In other words, is it true that XfelY = X(Q)? Yes, it is true in most cases. For example, when x[n] = 
a"u[n], its -transform is /( —a), and Xe?) = J (el2 — a), which is equal to X(Q) (assuming |a| < 1). However, for the unit step 


function u[n], the -transform is /(—1), and Xe A = A Q(ei@ — 1). As seen from Table 9.1, pair 10, this is not equal to X(Q) in this 
case. 


We obtained X[e/% by setting = e/ in Eq. (9.42a). This implies that the sum on the right-hand side of Eq. (9.42a) converges for = e/2, 
which means the unit circle (characterized by = el Q) lies in the region of convergence for X] ]. Hence, the general rule is that only when 
the ROC for X{ ] includes the unit circle, setting = e/2 in X[] yields the DTFT X(Q). This applies for all x[n] that are absolutely 


summable. If the ROC of X[] excludes the unit circle, Xfe/2 + X(Q). This applies to all exponentially growing x[n] and also x[n], which 
either is constant or oscillates with constant amplitude. 


The reason for this peculiar behavior has something to do with the nature of convergence of the -transform and the DTFT.[T] 


This discussion shows that although the DTFT may be considered to be a special case of the -transform, we need to circumscribe such 
a view. This cautionary note is supported by the fact that a periodic signal has the DTFT, but its -transform does not exist. 


[T]For the sake of simplicity we assume D, and therefore X(Q) to be real. The argument, however, is also valid for complex D, [or 
X(O)). 


[tlThis means 


4 
2 


M 


Ps 
. _ ~ jn = 
im [ X (22) S> x[nje d2Q=0 


n=—M 


[tT explain this point, consider the unit step function u[n] and its transforms. Both the -transform and the DTFT synthesize x[n], using 
everlasting exponentials of the form". The value of can be anywhere in the complex -plane for the -transform, but it must be restricted 
to the unit circle ( = el) in the case of the DTFT. The unit step function is readily synthesized in the -transform by a relatively simple 


spectrum X[ ] = /( — 1), by choosing outside the unit circle (the ROC for u[n] is | | > 1). In the DTFT, however, we are restricted to 


values of only on the unit circle ( = 2). The function u[n] can still be synthesized by values of on the unit circle, but the spectrum is 
more complicated than when we are free to choose anywhere including the region outside the unit circle. In contrast, when x[n] is 
absolutely summable, the region of convergence for the -transform includes the unit circle, and we can synthesize x[n] is absolutely 
summable, the region of convergence for the -transform includes the unit circle, and we can synthesize x[n] by using along the unit 


circle in both the transforms. This leads to Xel2 = X(Q). 


9.3 PROPERTIES OF THE DTFT 


In the next section, we shall see a close connection between the DTFT and the CTFT (continuous-time Fourier transform). For this 
reason, the properties of the DTFT are very similar to those of the CTFT, as the following discussion shows. 


LINEARITY OF THE DTFT 
ida] <=> X,(Q) and xin] — > X2(Q) 
then 

@X;[n] + aox2[n] > a, X1(Q) + a2XV(Q) (9.43) 
The proof is trivial. The result can be extended to any finite sums. 
CONJUGATE SYMMETRY OF X(Q) 


In Eq. (9.32b), we proved the conjugation property 


x'[n] — > X*(-Q) (9.44) 
We also showed that as a consequence of this, when x[n] is real, X(Q.) and X(—Q) are conjugates, that is, 
X(—Q) = X*(Q) (9.45) 
This is the conjugate symmetry property. Since X(Q) is generally complex, we have both amplitude and angle (or phase) spectra 
X(Q) = |X(Q)|e/ (9.46) 
Hence, for real x[n], it follows that 
|X (£2)| = |X (—Q)| (9.47a) 
£X(Q) = —ZX(—Q) (9.47b) 


Therefore, for real x[n], the amplitude spectrum |X(Q)| is an even function of Q and the phase spectrum L_X(Q) is an odd function of 
Q. 


TIME AND FREQUENCY REVERSAL 
x[—n] — > X(-Q) (9.48) 
From Eq. (9.30), the DTFT of x[—n] is 
oo oo 
DTFT{x[—2]} = S- x[-aje"/* = » x[m]e/™" = X(—Q) 


ASW Moan 


EXAMPLE 9.7 
Use the time-frequency reversal property (9.48) and pair 2 in Table 9.1 to derive pair 4 in Table 9.1. 


Pair 2 states that 
2 
y"u[z] = ——__ lyl<l (9.49a) 
eiQ—y 
Hence, from Eq. (9.48) 
—jX 


e 
y "u[—n] = ————— ly| <1 (9.49b) 
e itu y 


Moreover, y” could be expressed as a sum of y” u[n] and y~"u[—n], except that the impulse at n = 0 is counted twice (once from 


each of the two exponentials). Hence 

y"| = y"u[n] + y“"ul—n] — 8[n] 

Therefore, using Eqs. (9.49a) and (9.49b), and invoking the linearity property, we can write 
jn i > 


DTIFT{y"} = ee oe 
yoI= Gy" my ~ 1=2y cos + y? 


ly[<1 
which agrees with pair 4 in Table 9.1. 


EXERCISE E9.6 


In Table 9.1, derive pair 13 from pair 15 by using the time-reversal property (9.48). 
MULTIPLICATION BY n: FREQUENCY DIFFERENTIATION 


,dX(Q) 
nx[n] <> HY 2 


The result follows immediately by differentiating both sides of Eq. (9.30) with respect to 0. 


(9.50) 


EXAMPLE 9.8 


Use the property in Eq. (9.50) [multiplication by n] and pair 2 in Table 9.1 to derive pair 5 in Table 9.1. 
Pair 2 states that 
ef® 
y*uln| = —— ly| <1 (9.51) 
ey 


Hence, from Eq. (9.50) 


‘ a [ a yel® 
ny ui =i a} = lv} <1 


which agrees with pair 5 in Table 9.1. 


TIME-SHIFTING PROPERTY 


If 
x[n] => X(Q) 
then 
xin — k] ==> X(Q)e for integer k (9.52) 
This property can be proved by direct substitution in the equation defining the direct transform. From Eq. (9.30) we obtain 
ioe) oo 


x[n ee k] —=> -& x[n = ke = ye x[mJe~2 2m! 


Aan=—-CO M=—OO 


Oo 
= eI ., x[mJe"/2" = e~#"° XQ) 
a=—cO 


This result shows that delaying a signal by k samples does not change its amplitude spectrum. The phase spectrum, however, is 
changed by —kQ. This added phase is a linear function of O with slope -k. 


PHYSICAL EXPLANATION OF THE LINEAR PHASE 


Time delay in a signal causes a linear phase shift in its spectrum. The heuristic explanation of this result is exactly parallel to that for 
continuous-time signals given in Section 7.3 (see Fig. 7.22). 


EXAMPLE 9.9 


Find the DTFT of x[n] = (1/4) sinc (tt(n — 2)/4), shown in Fig. 9.8a. 
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Figure 9.8: Shifting x[n] by k units changes the phase of X(Q) by kQ. 


In Example 9.6, we found that 

1. (xn = Q—2nm 

; sine( =) —=— 2m (eo) 

Use of the time-shifting property [Eq. (9.52)] yields (for integer k) 


~ 


| a(n —2) Q— 2am p22 
4 sine (7) — a rect (>) e (9.53) 


M00 


The spectrum of the shifted signal is shown in Fig. 9.8b. 


EXERCISE E9.7 


Verify the result in Eq. (9.40) from pair 7 In Table 9.1, and the time-shifting property of the DTFT. 
FREQUENCY-SHIFTING PROPERTY 


If 
x[n] — > X(Q) 
then 
x[njei** <=> X(Q—Q,) (9.54) 
This property is the dual of the time-shifting property. To prove the frequency-shifting property, we have from Eq. (9.30) 
~ “x 
x[nJei@" > b Ss x[njei@"e™ = 2: x[nJe A 8" = X(Q-—Q,) 


Asoo nm-—00 


From this result, it follows that 
x[nje 7%" <=> X(Q + Q.) 
Adding this pair to the pair in Eq. (9.54), we obtain 

x[n]} cos (Qn) <=> ${X(Q — Q.) + X(Q+ Q.} (9.55) 
This is the modulation property. 
Multiplying both sides of pair (9.54) by e/? we obtain 

x[njei@"* > X(Q— 2.)e” (9.56) 
Using this pair, we can generalize the modulation property as 


x[n]cos (Qn +O) em 4{X(Q— Q.je” + X(QNFH+ QO} (9.57) 


EXAMPLE 9.10 


A signal x[n] = sinc (ttn/4) modulates a carrier cos O,n. Find and sketch the spectrum of the modulated signal x[n] cos O,n for 
a. Og = 1/2 
b. O, = 71/8 = 0.87511 


a. For x[n] = sinc (t1n/4), we find (Table 9.1, pair 8) 


Q— 27m 
X(Q) =4 > rect (=—") 


m=—oo 
Figure 9.9a shows the DTFT X(Q). From the modulation property (9.55), we obtain 


2—O5a —27m 2+ 0.52 — 2am 
5 ? a ~—x ec ———- StCS 
xIn} cos (0.520) ==> 2 23 rect ( 05x ) ( 0.Sx 


Figure 9.9b shows half the X(Q) shifted by Tr/2 and Fig. 9.9c shows half the X(Q) shifted by —11t/2. The spectrum of the 
modulated signal, is obtained by adding these two shifted spectra and multiplying by half, as shown in Fig. 9.9d. 
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Figure 9.9: Instance of modulation for Example 9.10a. 


. Figure 9.10a shows X(Q), which is the same as that in part a. For O, = 711/8 = 0.875T1, the modulation property (9.55) 
yields 
Xx[a]cos (0.8752n) emma 2 »® rect 
Figure 9.10b shows X(Q) shifted by 711/8 and Fig. 9.10c shows X(Q) shifted by —711/8. The spectrum of the modulated 
signal, is obtained by adding these two shifted spectra and multiplying by half, as shown in Fig. 9.10d. In this case, the 
two shifted spectra overlap. Since, the operation of modulation thus causes aliasing, it does not achieve the desired effect 
of spectral shifting. In this example, to realize spectral shifting without aliasing requires OQ, < 3117/4. 
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Figure 9.10: Instance of modulation for Example 9.10b 


EXERCISE E9.8 


In Table 9.1, derive pairs 12 and 13 from pair 11 and the frequency-shifting/modulation property. 
TIME-AND FREQUENCY-CONVOLUTION PROPERTY 


If 
xiln] = X1(Q) and x2[n] — > X2(Q) 


then 
Xiln] * x2[n] <> X1(Q)X2(Q) (9.58a) 


and 
I 
X,[n)x.[n] — Fg MUM” X2(Q) (9.58b) 


where 
wo 


x,["] * x2,[n] = >, X\[m]x,[2 — m] 


m—— Oo 
For two continuous, periodic signals, we define the periodic convolution, denoted by symbol PD aslt] 


l 
Xj (QHV\D X2(L2Q) = =| X)(u)X2(Q —u)du 


The convolution here is not the /inear convolution used so far. This is a periodic (or circular) convolution applicable to convolution of two 
continuous, periodic functions with the same period. The limit of integration in the convolution extends only to one period. 


Proof of the time convolution property is identical to that given in Section 5.2 [Eq. (5.18)]. All we have to do is replace with el. To 
prove the frequency - -convolution property (9.58b), we have 


xi[nleain] — . x {nlx{nje 7 = = x{n] Le I. Xi(we du ei 


a= a0 an oo 


Interchanging the order of atmmalion ou integration, we obtain 


yi [abeia] — =f Xi(u) 3 x{nje "| du = =f X(u)X1Q —u)du 


La= 00 


EXAMPLE 9.11 


if x[n] <> X (22), then show that 


id oo elf 
Do xUk] > 7X(0) D7 8(2 ~ 2k) + —]— 


buxoo taco 


i X (2) (9.59) 


Recognize that the sum on the left-hand side of (9.59) is x[n] * u[n] because 
be a) n 


x[n] xuln]= >> xfkluln —k1= S> xfkl 


k=—00 k=—90 


In deriving this result, we have used the fact that 


an—ni={y tS 

Hence, from the time-convolution | property (9.58a) and pair 10 in Table 9.1, it follows that 

ya => X(Q) x Do 5a 2ak) + = a = 

Because of 2tr periodicity, X(0) = X(2ttk). Moreover, X (0)5(0.- 21tk)=X(211k)8(Q—211k)=X(0)5(Q—211k). Hence 
a x[k] <> 7X (0) - 5(Q—2xk) + <a aX) 

k=—co k=—00 


EXERCISE E9.9 


In Table 9.1, derive pair 9 from pair 8, assuming 0, <11/2. Use the frequency-convolution property. 


PARSEVAL'S THEOREM 


If 
x[n] => X(Q) 


then E,, the energy of x[n], is given by 


= 5 1 > 

E, ™ Dee x[n]|? = =z ff Ko) dQ (9.60) 

To prove this property, we have from Eq. (9.44) 
be <) 

X"(Q) = S> x'[nJe™ (9.61) 

Now 
~ ‘ ~ . oo : 1 7 

p> [x[ajl° = 2? [n}x{n] = 2+ [n] lef X(Q)e?* aq] 


l = * fle 
= =f X(Q) p> x"[nJe! dQ 


=-a~ 


EXAMPLE 9.12 


Find the energy of x[n] = sine (0,n), assuming OQ, < Tr. 
From pair 8, Table 9.1, the fundamental band spectrum of x[n] is 


|| <2 


bs 
i 22. — t 
sinc({2.n) <> 2, rec (= 


Hence, from the Parseval theorem in Eq. (9.60), we have 


lL fixe ay]? 
ear fm (z)| 


Recognizing that rect (Q/20,) = 1 over |Q|<Q., and is zero otherwise, the preceding integral yields 
1 (2s? n 
E, = — (= } 22.) = — 
* "2a \Q? - 2, 


Table 9.2: Properties of the DTFT 
= Open table as spreadsheet 


[Operation — asst ts XQ) 
Linearity a4Xx4[n]+aox2[n] a4X4(Q)tagxo(Q) 
Multiplication by n nx[n] dX (82) 

172 


Frequency convolution x4[n]x2[n] ~/ X,[u]Xs2 — udu 
2 In 
Parseval's theorem Eat | IX(@)2 da 
T Jon 


[tin Eq. (8.36), we defined periodic convolution for two discrete, periodic sequences in a different way. Although, we are using the 
same symbol ‘P) for both discrete and continuous cases, the meaning will be clear from the context. 


9.4 LTI DISCRETE-TIME SYSTEM ANALYSIS BY DTFT 


Consider a linear, time-invariant, discrete-time system with the unit impulse response h[n]. We shall find the (zero-state) system 
response y[n] for the input x[n]. Let 
x[n] <> X(Q) y[n] —> Y(Q) and h[n] <> H(Q) 


Because 

y[n] = x[n] « A[n] (9.62) 
According to Eq. (9.58a) it follows that 

Y(Q) = X(Q)A(Q) (9.63) 


This result is similar to that obtained for continuous-time systems. Let us examine the role of H(Q), the DTFT of the unit impulse 
response h[n]. 


Equation (9.63) holds only for BIBO-stable systems and also for marginally stable systems if the input does not contain the system's 


natural mode(s). In other cases, the response grows with n and is not Fourier transformable. [t] Moreover, the input x[n] also has to be 
DTF transformable. For cases where Eq. (9.63) does not apply, we use the -transform for system analysis. 


Equation (9.63) shows that the output signal frequency spectrum is the product of the input signal frequency spectrum and the 
frequency response of the system. From this equation, we obtain 


IY (Q)| = |X(Q)| | A(Q)| (9.64) 
and 


ZY(Q) = £X(Q) + ZH(Q) (9.65) 


This result shows that the output amplitude spectrum is the product of the input amplitude spectrum and the amplitude response of the 
system. The output phase spectrum is the sum of the input phase spectrum and the phase response of the system. 


We can also interpret Eq. (9.63) in terms of the frequency-domain viewpoint, which sees a system in terms of its frequency response 
(system response to various exponential or sinusoidal components). The frequency domain views a signal as a sum of various 
exponential or sinusoidal components. The transmission of a signal through a (linear) system is viewed as transmission of various 
exponential or sinusoidal components of the input signal through the system. This concept can be understood by displaying the input- 
output relationships by a directed arrow as follows: 


e/™* —» H(Q)ei™ 
which shows that the system response to e/2” is H(Q)e/2", and 
1 ; 
x[n] = = | X (Qe! dQ 
27 Qn 


~ 


which shows x[n] as a sum of everlasting exponential components. Invoking the linearity property, we obtain, 


I 
y[n] = =| X(Q)H(Q)e!™ dQ 


— 


which gives y[n] as a sum of responses to all input components and is equivalent to Eq. (9.63). Thus, X(Q) is the input spectrum and 
Y(Q) is the output spectrum, given by X(Q)H(Q). 


EXAMPLE 9.13 
An LTID system is specified by the equation 


y[n] — 0.5y[n — 1] = x[n] (9.66) 


Find H(Q), the frequency response of this system. Determine the (zero-stable) response y[n] if the input x[n] = (0.8)"u[n]. 


Let x[n] = X(Q) and y[n] = Y(Q). The DTFT of both sides of Eq. (9.66) yields 
(1—0.5e-#")Y(Q) = X(Q) 
According to Eq. (9.63) sa 
Y(Q) 1 e 
H(Q) = —— = ——_-. = —-—___ 
(2) X(Q) 1-—eJ2@  eiX®-0.5 


Also, x[n] = (0.8)"ufn]. Hence, 


e/ 
X(Q) = Faroe 


and 


. oie, 2ei® 
(Q) (82) H (82) (ei2 — 0.8)(ei2 — 0.5) 


We can express the right-hand side as a sum of two first-order terms (modified partial fraction expansion as discussed in Section B.5- 
6) as follows:!T] 


Y(Q) eff 


ei — (eit —05)(e@ —0.8) 


8 
3 


20.5 | g@—O8 


Consequently 


5 eff 8 ei@ 
Y(Q) = -—| - | ——— -j—_—— 
(82) (3) 53 + (§) e/2@ — 0.8 


+(e Oe 
~ A\3) 1-0.5e-i2 3) 1-0.8e-i2 


According to Eq. (9.34a), the inverse DTFT of this equation is 
yin] = [-4(0.5)" + £(0.8)"] ula] (9.67) 


This example demonstrates the procedure for using DTFT to determine an LTID system response. It is similar to the Fourier transform 
method in the analysis of LTIC systems. As in the case of the Fourier transform, this method can be used only if the system is 


asymptotically or BIBO stable and if the input signal is DTF-transformable.!t! We shall not belabor this method further because it is 
clumsier and more restrictive than the -transform method discussed in Chapter 5. 


9.4-1 Distortionless Transmission 


In several applications, digital signals are passed through LTI systems, and we require that the output waveform be a replica of the 
input waveform. As in the continuous-time case, transmission is said to be distortionless if the input x[n] and the output y[n] satisfy the 
condition 


y[n] = Gox[n — ng] (9.68) 
Here ng, the delay (in samples) is assumed to be integer. The Fourier transform of Eq. (9.68) yields 
Y (Q) = Go X(Q) e 1 


But 
Y(Q) = X(Q) H(Q) 


Therefore 


H(Q) — Go ef 


This is the frequency response required for distortionless transmission. From this equation it follows that 


| H(2)| = Go (9.69a) 
£H(Q) = —Qnz (9.69b) 


Thus, for distortionless transmission, the amplitude response |H(Q)| must be a constant, and the phase response ZH(Q) must be a 


linear function of O with slope —ng, where nq is the delay in number of samples with respect to input (Fig. 9.11). These are precisely 
the characteristics of an ideal delay of ng samples with a gain of Go [see Eq. (9.52)]. 


LHQO) = -—ony 


Figure 9.11: LT| system frequency response for distortionless transmission. 


MEASURE OF DELAY VARIATION 

For distortionless transmission, we require a linear phase characteristic. In practice, many systems have a phase characteristic that may 
be only approximately linear. A convenient way of judging phase linearity is to plot the slope of 7 H(Q) as a function of frequency. This 
slope is constant for ideal linear phase (ILP) system, but it may vary with QO in general case. The slope can be expressed as 


d 
n,(&) = ——~ZH(Q) (9.70) 
If Ng(Q) is constant, all the components are delayed by ng samples. But if the slope is not constant, the delay ng varies with frequency. 


This variation means that different frequency components undergo different amounts of delay, and consequently the output waveform 
will not be a replica of the input waveform. As in the case of LTIC systems, ng(Q), as defined in Eq. (9.70), plays an important role in 


bandpass systems and is called the group delay or envelope delay. Observe that constant ng implies constant ng. Note that 2H(Q) = 
9 —Qng also has a constant ng. Thus, constant group delay is a more relaxed condition. 


DISTORTIONLESS TRANSMISSION OVER BANDPASS SYSTEMS 

As in the case of continuous-time systems, the distortionless transmission conditions can be relaxed for discrete-time bandpass 
systems. For lowpass systems, the phase characteristic should not only be linear over the band of interest, but should also pass 
through the origin [condition (9.69b)]. For bandpass systems, the phase characteristic should be linear over the band of interest, but it 
need not pass through the origin (ng should be constant). The amplitude response is required to be constant over the passband. Thus, 
for distortionless transmission over a bandpass system, the frequency response for positive range of O is of the form 1] 


H(Q) = Goe! -) Q>0 


The proof is identical to that for the continuous-time case in Section 7.4-2 and will not be repeated. In using Eq. (9.70) to compute ng, 
we should ignore jump discontinuities in the phase function. 


9.4-2 Ideal and Practical Filters 


Ideal filters allow distortionless transmission of a certain band of frequencies and suppress all the remaining frequencies. The general 
ideal lowpass filter shown in Fig. 9.12 for |QO|<tt allows all components below the cutoff frequency Q=Q,, to pass without distortion and 


suppresses all components above 0. Figure 9.13 illustrates ideal highpass and bandpass filter characteristics. 
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Figure 9.12: Ideal lowpass filter: its frequency response and impulse response. 
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Figure 9.13: Ideal highpass and bandpass filter frequency response. 


The ideal lowpass filter in Fig. 9.12a has a linear phase of slope — ng, which results in a delay of ng samples for all its input 
components of frequencies below 0, rad/sample. Therefore, if the input is a signal x[n] bandlimited to O, the output y[n] is x[n] delayed 
by ng, that is, 

y[n] = x[n — ng] 


The signal x[n] is transmitted by this system without distortion, but with delay of ng samples. For this filter, 


oO 


2-2 1 
H(Q) = ys rect (“$5 "Je sang (9.7 la) 


Mt OO 


The unit impulse response h[n] of this filter is obtained from pair 8 (Table 9.1) and the time-shifting property 


2. 
h{nj = = sinc [Q.(n — ny)] (9.71b) 
Because h[n] is the system response to impulse input 8[n], which is applied at n = 0, it must be causal (i.e., it must not start before n = 
0) for a realizable system. Figure 9.12b shows hA[n] for O, = 11/4 and ng = 12. This figure also shows that A[n] is noncausal and hence, 
unrealizable. Similarly, one can show that other ideal filters (such as the ideal highpass or and bandpass filters depicted in Fig. 9.13) 
are also noncausal and therefore physically unrealizable. 


One practical approach to realize ideal lowpass filter approximately is to truncate both tails (positive and negative) of h[n] so that it has 
a finite length and then delay sufficiently to make it causal (Fig. 9.14). We now synthesize a system with this truncated (and delayed) 
impulse response. For closer approximation, the truncating window has to be correspondingly wider. The delay required also increases 
correspondingly. Thus, the price of closer realization is higher delay in the output; this situation is common in noncausal systems. 
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Figure 9.14: Approximate realization of an ideal lowpass filter by truncation of its impulse response. 


[T]lt does not hold for asymptotically unstable systems whose impulse response h[n] does not have DTFT. In case the system is 
marginally stable and the input does not contain the system's mode term, the response does not grow with n and is, therefore, Fourier 
transformable. 

[tlHere Y(Q) is a function of variable e!2. Hence, x = e/? for the purpose of comparison with the expression in Section B.5-6. 


[Tit can also be applied to marginally stable systems if the input does not contain natural mode(s) of the system. 


[t]Because the phase function is an odd function of Q, if LH(Q) = © — Ong for A= 0, over the band 2W (centered at Q,), then LH(Q) 
= —®9 — Ong for QO < 0 over the band 2W (centered at —Q,). 


9.5 DTFT CONNECTION WITH THE CTFT 


Consider a continuous-time signal x,(t) (Fig. 9.15a) with the Fourier transform X,(w) bandlimited to B Hz (Fig. 9.15b). This signal is 
sampled with a sampling interval T. The sampling rate is at least equal to the Nyquist rate; that is, T = 1/2B. The sampled signal xB,(f) 
(Fig. 9.15c) can be expressed as 

~ 


¥-(t)= > x(nT)8(t —aT) 
a=>—0O0 
The continuous-time Fourier transform of the foregoing equation yields 
~ 
X-(@) = ie xe(nT) ete (9.72) 
In Section 8.1 (Fig. 8.1f), we showed that X,(W) is X,(w)/T repeating periodically with a period Wg, = 2Tr/T, as illustrated in Fig. 9.15d. 
Let us construct a discrete-time signal x[n] such that its nth sample value is equal to the value of the nth sample of x,(t), as depicted in 
Fig. 9.15e, that is, 
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Figure 9.15: Connection between the DTFT and the Fourier transform 


x[n] = x-(nT) (9.73) 
Now, X(Q), the DTFT of x[n], is given by 


oo ~ 
X(Q)= re x[n]e""** = :e x-(nT) e2"™ (9.74) 


Comparison of Eqs. (9.74) and (9.72) shows that letting wT = QO in X,(w) yields X(Q), that is, 


X (2) = X-(@)lor-a (9.75) 
Alternately, X(Q) can be obtained from X,(w) by replacing w with O/T, that is, 
=: Fa 
A(R)= Az (=) (9.76) 


Therefore, X(Q) is identical to X,(w), frequency-scaled by factor T, as shown in Fig. 9.15f. Thus, w = 21t/T in Fig. 9.15d corresponds 
to O = 2Tt in Fig. 9.15f. 


9.5-1 Use of DFT and FFT for Numerical Computation of DTFT 


The discrete Fourier transform (DFT), as discussed in Chapter 8, is a tool for computing the samples of continuous-time Fourier 
transform (CTFT). Because of the close connection between CTFT and DTFT, as seen in Eq. (9.76), we can also use this same DFT to 
compute DTFT samples. 


In Chapter 8, Eqs. (8.22a) and (8.22b) relate an No-point sequence x, to another Ng-point sequence X,. Changing the notation x, to 
X[n], in these equations, we obtain 


No-! 


X,= >) xinje*™ (9.77a) 
a= 
No-1 
l ‘< = 2a 
x[a] = — X,er™ X=— 9,.77b 
[n] Ny Dy ** a (9.77b) 
Comparing Eq. (9.30) with Eq. (9.77a), we recognize that X, is the sample of X(Q) at O = rQg, that is, 

27 

X,=X(r&%) M=— 

No 


Hence, the pair of DFT equations (9.77) relates an Ng-point sequence x[n] to the Ng-point samples of corresponding X(Q). We can 
now use the efficient algorithm FFT (discussed in Chapter 8) to compute X; from x[n], and vice versa. 


If x[n] is not timelimited, we can still find the approximate values of X, by suitably windowing x[n]. To reduce the error, the window 
should be tapered and should have sufficient width to satisfy error specifications. In practice, numerical computation of signals, which 
are generally nontimelimited, is performed in this manner because of the computational economy of the DFT, especially for signals of 
long duration. 


COMPUTATION OF DISCRETE-TIME FOURIER SERIES (DTFS) 
The discrete-time Fourier series (DTFS) equations (9.8) and (9.9) are identical to the DFT equations (8.22b) and (8.22a) within a 


scaling constant No. If we let x[n] = Nox, and D, = X, in Eqs. (9.9) and (9.8), we obtain 


No-I 
X, =) xge7ie" 


na=0 


2x 
— 2, X,ei" on Qo = Ne (9.78) 


This is precisely the DFT pair in Eqs. (8.22). For instance, to compute the DTFS for the periodic signal in Fig. 9.2a, we use the values 
of Xp = x[n]/No as 


= O<n<4 and 28<a <31 


0 5 <a <27 


Xn = 


Numerical computations in modern digital signal processing are conveniently performed with the discrete Fourier transform, introduced 
in Section 8.5. The DFT computations can be very efficiently executed by using the fast Fourier transform (FFT) algorithm discussed in 
Section 8.6. The DFT is indeed the workhorse of modern digital signal processing. The discrete-time Fourier transform (DTFT) and the 
inverse discrete-time Fourier transform (IDTFT) can be computed by using the DFT. For an No-point signal x[n], its DFT yields exactly 
No samples of X(Q) at frequency intervals of 21T/Ng. We can obtain a larger number of samples of X(Q) by padding a sufficient 
number of zero-valued samples to x[n]. the No-point DFT of x[n] gives exact values of the DTFT samples if x[n] has a finite length No. 
If the length of x[n] is infinite, we need to use the appropriate window function to truncate x[n]. 


Because of the convolution property, we can use DFT to compute the convolution of two signals x[n] and h[n], as discussed in Section 
8.5. This procedure, known as fast convolution, requires padding both signals by a suitable number of zeros, to make the linear 
convolution of the two signals identical to the circular (or periodic) convolution of the padded signals. Large blocks of data may be 
processed by sectioning the data into smaller blocks and processing such smaller blocks in sequence. Such a procedure requires 


smaller memory and reduces the processing time.!7] 


[]Mitra, S. K. Digital Signal Processing: A Computer-Based Approach, 2nd ed. McGraw-Hill, New York, 2001. 


9.6 GENERALIZATION OF THE DTFT TO THE z-TRANSFORM 


LTID systems can be analyzed by using the DTFT. This method, however, has the following limitations: 


1. Existence of the DTFT is guaranteed only for absolutely summable signals. The DTFT does not exist for exponentially or 
even linearly growing signals. This means that the DTFT method is applicable only for a limited class of inputs. 


2. Moreover, this method can be applied only to asymptotically or BIBO stable systems; it cannot be used for unstable or 
even marginally stable systems. 


These are serious limitations in the study of LTID system analysis. Actually it is the first limitation that is also the cause of the second 
limitation. Because the DTFT is incapable of handling growing signals, it is incapable of handling unstable or marginally stable 


systems.!T] Our goal is, therefore, to extend the DTFT concept so that it can handle exponentially growing signals. 


We may wonder what causes this limitation on DTFT so that it is incapable of handling exponentially growing signals. Recall that in 


DTFT, we are using sinusoids or exponentials of the form ON to synthesize an arbitrary signal x[n]. These signals are sinusoids with 
constant amplitudes. They are incapable of synthesizing exponentially growing signals no matter how many such components we add. 
Our hope, therefore, lies in trying to synthesize x[n] by using exponentially growing sinusoids or exponentials. This goal can be 


accomplished by generalizing the frequency variable j/Q to o + jQ, that is, by using exponentials of the form e(F +J2)" instead of 
exponentials e2” The procedure is almost identical to that used in extending the Fourier transform to the Laplace transform. 


Let us define a new variable X(jQ) = X(22) Hence 


wo 


XQ) = De, x[n}e 7" (9.79) 
and 

x[n] = | X(jQ) e/™ dQ (9.80) 

£7 n 

Consider now the DTFT of x[n]Je °" (o real) 

DTFT {x[nJe~°"} = > x[n]e~" ei" (9.81) 

. : 
= x; x[n] e~ Ot (9.82) 


a=—20 


It follows from Eq. (9.79) that the sum in Eq. (9.82) is X(@ + /&2) Thus 


x 
DIFT {x[aje~"} = S> x[njen@/™" = X(o + JQ) (9.83) 


Rao 


Hence, the inverse DTFT of X(@ + J&)is x[n]e"°”. Therefore 
1 fs 
x[n]e-** = ~ | Ro + fQve™ a (9.84) 
Multiplying both sides of Eq. (9.84) by e°” yields 
l ¥ ~ oy 
x[n] = =| Ro + JQ e°+/™ dO (9.85) 
Let us define a new variable as 
z=e’"" so that Inz=o+jQ and Lae = jdQ (9.86) 


Because = e°*/® is complex, we can express it as = re!2, where r = e°. Thus, lies on a circle of radius r, and as Q varies from —o to 


o, circumambulates along this circle, completing exactly one counterclockwise rotation, as illustrated in Fig. 9.16. Changing to variable in 
Eq. (9.85) yields 
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Figure 9.16: Contour of integration for the -transform. 
l O n—t 
x[a] = — > X(inz) 2" ‘dz (9.87a) 
2nj 


and form Eq. (9.83) we obtain 


oo 


X(inz)= > xiniz" (9.87b) 


Aa=>=—2o 
where the integral x indicates a contour integral around a circle of radius rin the counterclockwise direction. 


Equations (9.87a) and (9.87b) are the desired extensions. They are, however, in a clumsy form. For the sake of convenience, we make 


another notational change by observing that X(In ) is a function of .Let us denote it by a simpler notation X[ ]. Thus, Eqs. (9.87) 
become 


I 
10) = 5 f Xt2lz" ldz (9.88) 


and 


oO 


Xizl= > xIa)z” (9.89) 


a>=—cao 
This is the (bilateral) transform pair. Equation (9.88) expresses x[n] as a continuous sum of exponentials of the form” = e(Ot/9)n = -n 
e/©)". Thus, by selecting a proper value for r (or 0), we can make the exponential grow (or decay) at any exponential rate we desire. 
If we let o = 0, we have = e/@ and 


X{[z]lqwe = X(inz)|,_ ja = X(jQ) = X(Q) (9.90) 


Thus, the familiar DTFT is just a special case of the -transform X[ ] obtained by letting = e/® and assuming that the sum on the right- 
hand side of Eq. (9.89) converges when = e/®. This also implies that the ROC for X{ ] includes the unit circle. 


[t]Recall that the output of an unstable system grows exponentially. Also, the output of a marginally stable system to characteristic 
mode input grows with time. 


9.7 SUMMARY 


This chapter deals with the analysis and processing of discrete-time signals. For analysis, our approach is parallel to that used in 
continuous-time signals. We first represent a periodic x[n] as a Fourier series formed by a discrete-time exponential and its harmonics. 
Later we extend this representation to an aperiodic signal x[n] by considering x[n] to be a limiting case of a periodic signal with period 
approaching infinity. 


Periodic signals are represented by discrete-time Fourier series (DTFS); aperiodic signals are represented by the discrete-time Fourier 
integral. The development, although similar to that of continuous-time signals, also reveals some significant differences. The basic 
jot 


difference in the two cases arises because a continuos-time exponential e has a unique waveform for every value of w in the range 
—oo to o. In contrast, a discrete-time exponential 2/2” has a unique waveform only for values of Q in a continuous interval of 2T1T. 
Therefore, if Qo is the fundamental frequency, then at most 21T/Og exponentials in the Fourier series are independent. Consequently, 
the discrete-time exponential Fourier series has only No = 2Tt/Qo terms. 


The discrete-time Fourier transform (DTFT) of an aperiodic signal is a continuous function of OQ and is periodic with period 21. We can 
synthesize x[n] from spectral components of X(Q) in any band of width 211. In a basic sense, the DTFT has a finite spectral width of 
2Tt, which makes it bandlimited to tr radians. 


Linear, time-invariant, discrete-time (LTID) systems can be analyzed by means of the DTFT if the input signals are DTF transformable 
and if the system is stable. Analysis of unstable (or marginally stable) systems and/or exponentially growing inputs can be handled by 
the -transform, which is a generalized DTFT. The relationship of the DTFT to the - transform is similar to that of the Fourier transform to 
the Laplace transform. Whereas the - transform is superior to the DTFT for analysis of LTID systems, the DTFT is preferable in signal 
analysis. 


If H(Q) is the DTFT of the system's impulse response A[n], then |H(Q)| is the amplitude response, and 2H(Q) is the phase response 
of the system. Moreover, if X(Q) and Y(Q) are the DTFTs of the input x[n] and the corresponding output y[n], then Y(Q) = H(Q)X(Q). 
Therefore the output spectrum is the product of the input spectrum and the system's frequency response. 


Because of the similarity between the DFT and DTFT relationships, numerical computations of the DTFT of finite-length signals can be 
handled by using the DFT and the FFT, introduced in Sections 8.5 and 8.6. For signals of infinite length, we use a window of suitable 
length to truncate the signal so that the final results are within a given error tolerance. 
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MATLAB SESSION 9: WORKING WITH THE DTFS AND THE DTFT 


This session investigates various methods to compute the discrete-time Fourier series (DTFS). Performance of these methods is 
assessed by using MATLAB's stopwatch and profiling functions. Additionally, the discrete-time Fourier transform (DTFT) is applied to the 
important topic of finite impulse response (FIR) filter design. 


M9.1 Computing the Discrete-Time Fourier Series 


Within a scale factor, the DTFS is identical to the DFT. Thus, methods to compute the DFT can be readily used to compute the DTFS. 
Specifically, the DTFS is the DFT scaled by 1/Ng. As an example, consider a 50 Hz sinusoid sampled at 1000 Hz over one-tenth of a 
second. 


>> T 
>> X 


1/1000; N 0 = 100; n = (0:N 0-1)'; 
cos (2*pi*50*n*T) ; — 


The DTFS is obtained by scaling the DFT. 


>> X = fft (x) /N_0; £ = (O0:N_0-1) / (T*N_0); 
>> stem (f-500, fftshift (abs (X)), 'k'); axis ([-500 500 -0.1 0.6]); 
>> xlabel ('f [Hz]'); ylabel ("|X (f)|'); 


Figure M9.1 shows a peak magnitude of 0.5 at +50 Hz. This result is consistent with Euler's representation 


Ix(f)| 
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Figure M9.1: DTFS computed by scaling the DFT. 
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Lacking the 1/No scale factor, the DFT would have a peak amplitude 100 times larger. 


cos (27 50nT) = 


The inverse DTFS is obtained by scaling the inverse DFT by No. 


>> x hat = real (ifft (X) *N_O); 
>> stem (n, x hat, 'k'); axis ([0 99 -1.1 1.1]); 
>> xlabel ('n'"); ylabel ('x {hat} [n]"'); 


Figure M9.2 confirms that the sinu soid x[n] is properly recovered. Although the result is theoretically real, computer round-off errors 
produce a small imaginary component, which the real command removes. 
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Figure M9.2: Inverse DTFS computed by scaling the inverse DFT. 
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Although the ff£t provides an efficient method to compute the DTFS, other important computational methods exist. A matrix-based 
approach is one popular way to implement Eq. (9.9). Although not as efficient as an FFT-based algorithm, matrix-based approaches 
provide insight into the DTFS and serve as an excellent model for solving similarly structured problems. 


To begin, define Wag = @/20 which is a constant for a given No. Substituting Wyo into Eq. (9.9) yields 
No-1 


D, = = So xln Wy” 


0 n=O 


An inner product of two vectors computes D,. 


x[O} 


; x[1] 
|: eae r er —(No-Dr xf2 
D,= [1 Wao Wa. Waar] | 22) 
{ . 
XI No = 1] 
Stacking the results for all r yields: 
Dy l I | 7 ! x[0] 
D, 1 Wy Wee eye xl] 
D: | = - 1 Wy “ my {21 (M9.1) 
Dy, BW wgeD 0. ge] LxiN — 1) 


In matrix notation, Eq. (M9.1) is compactly written as 
l 
Dp = —Wy,x 
No . 
Since it is also used to compute the DFT, matrix Wy is often called a DFT matrix. 


Program MS9P1 computes the No-by-Ng DFT matrix Wyo. Although not used here, the signal processing toolbox function dftmtx 
computes the same DFT matrix, although in a less obvious but more efficient fashion. 


function [W] = MS9P1 (N 0); 

% MS9P1.m : MATLAB Session 9, Program 1 

% Function M-file computes the N 0 -by -N 0 DFT matrix W. 
W = (exp (-j*2*pi/N 0)). * ((0: N O-1)' * (0: N O-1)); 


While less efficient than FFT-based methods, the matrix approach correctly computes the DTFS. 


>> W = MS9P1 (100); X = W*x/N 0; 
>> stem (f-500, fftshift (abs (X)), 'k'); axis ([-500 500 -0.1 0.6]); 
>> xlabel ('f [Hz]'); ylabel ('|X(f)1|'); 


The resulting plot is indistinguishable from Fig. M9.1. Problem 9.M-1 investigates a matrix-based approach to compute Eq. (9.8), the 
inverse DTFS. 


M9.2 Measuring Code Performance 


Writing efficient code is important, particularly if the code is frequently used, requires complicated operations, involves large data sets, 
or operates in real time. MATLAB provides several tools for assessing code performance. When properly used, the profile function 
provides detailed statistics that help assess code performance. MATLAB help thoroughly describes the use of the sophisticated 
profile command. 


A simpler method of assessing code efficiency is to measure execution time and compare it with a reference. The MATLAB command 
tic starts a stopwatch timer. The toc command reads the timer. Sandwiching instructions between tic and toc returns the elapsed 
time. For example, the execution time of the 100-point matrix-based DTFS computation is: 


>> tic; W*x/N_0; toc 
lapsed_time = 0 


Different machines operate at different speeds with different operating systems and with different background tasks. Therefore, elapsed 
time measurements can very considerably from machine to machine and from execution to execution. In this particular case, however, a 
result other than zero is reported only by relatively slow machines. Execution times are so brief that MATLAB reports unreliable times or 
fails to register an elapsed time at all. 


To increase the elapsed time and therefore the accuracy of the time measurement, a loop is used to repeat the calculation. 


>> tic; for i = 1: 1000, W*x/N_0; end; toc 
lapsed_time = 0.4400 


This elapsed time suggests that each 100-point DTFS calculation takes around one-half millisecond. What exactly does this mean, 
however? Elapsed time is only meaningful relative to some reference. Consider the time it takes to compute the same DTFS using the 
FFT-based approach. 


>> tic; for i = 1: 1000, £fft (x) /N_0O; end; toc 
lapsed_time = 0.1600 


With this as a reference, the matrix-based computations appear to be several times slower than the FFT-based computations. This 


difference is more dramatic as No is increased. Since the two methods provide identical results, there is little incentive to use the slower 
matrix-based approach, and the FFT-based algorithm is generally preferred. Even so, the FFT can exhibit curious behavior: adding a 
few data points, even the artificial smaples introduced by zero padding, can dramatically increase or decrease execution times. The tic 
and toc commands illustrate this strange result. Consider computing the DTFS of 1015 random data points 1000 times. 


>> yl = rand (1015,1); 
>> tic; for i=l: 1000; fft (yl)/1015; end; Tl = toc 
Tl = 1.9800 


Next, pad the sequence with four zeros. 
>> y? = [yl; zeros (4, 1)]; 


>> tic; for i = 1:1000; fft (y2)/1019; end; T2 = toc 
T2 = 8.3000 


The ratio of the two elapsed times indicates that adding four points to an already long sequence increases the computation time by a 
factor of 4. Next, the sequence is zero-padded to a length of No = 1024. 
>> y3 = [y2; zeros (5, 1)]; 


>> tic; for i = 1:1000; fft (y3)/1024; end; T3 = toc 
T3 = 0.9900 


In this case, the added data decrease the original execution time by a factor of 2 and the second execution time by a factor of 8! These 
results are particularly surprising when it is realized that the lengths of y1, y2, and y3 differ by less than 1%. 


As it turns out, the efficiency of the f£t command depends on the factorability of Ng. With the factor command, 1015 = (5)(7)(29), 


1019 is prime, and 1024 = (2)'". The most factorable length, 1024, results in the fastest execution, while the least factorable length, 
1019, results in the slowest execution. To ensure the greatest factorability and fastest operation, vector lengths are ideally a power of 2. 


M9.3 FIR Filter Design by Frequency Sampling 


Finite impulse response (FIR) digital filters are flexible, always stable, and relatively easy to implement. These qualities make FIR filters 
a popular choice among digital filter designers. The difference equation of a length-N causal FIR filter is conveniently expressed as 
N-! 


yin} = Aoxlal + hyxta — 1p + --s thyeyaxln —(N - DJ] = So hexin —k| 

— 
The filter coefficients, or tap weights as they are sometimes called, are expressed using the variable h to emphasize that the 
coefficients themselves represent the impulse response of the filter. 


The filter's frequency response is 


Y(Q) N-1 
H(Q) = —— =V nei 
X(Q) 2 ; 


Since H(Q) is a 211 -periodic function of the continuous variable Q, it is sufficient to specify H(Q) over a single period (0 <O < 2Tt). 


In many filtering applications, the desired magnitude response |Hg(Q)| is known but not the filter coefficients h[n]. The question, then, is 
one of determining the filter coefficients from the desired magnitude response. 


Consider the design of a lowpass filter with cutoff frequency Q, = 11/4. An inline function represents the desired ideal frequency 
response. 
>> H_d = inline ('mod (Omega, 2*pi)<pi/4) + (mod (Omega, 2*pi) < 2*pi-pi/4)'); 


Since the inverse DTFT of Hg(Q) is a sampled sinc function, it is impossible to perfectly achieve the desired response with a causal, 
finite-length FIR filter. A realizable FIR filter is necessarily an approximation, and an infinite number of possible solutions exist. Thought 
of another way, Hg(Q) specifies an infinite number of points, but the FIR filter only has N unknown tap weights. In general, we expect a 
length-N filter to match only N points of the desired response over (0 <Q < 211). Which frequencies should be chosen? 


A simple and sensible method is to select N frequencies uniformly spaced on the interval (0 
<O<2tr),(0,2Tt/N,0,4p/N,0,6p/N,...(N—1)21t/N). By choosing uniformly spaced frequency samples, the N-point inverse DFT can be 
used to determine the tap weights h[n]. Program MS9P2 illustrates this procedure. 


function [h] = MS9P2 (N,H ad); 
MS9P2.m : MATLAB Session 9, Program 2 
Function M-file designs a length-N FIR filter by sampling the desired 
magnitude response H. Phase of magnitude samples is left as zero. 
INPUTS: N = desired FIR filter length 

H d = inline function that defines the desired magnitude response 
OUTPUTS: h = impulse response (FIR filter coefficients) 


AP AP alP oP AP AP 


ae 


Create N equally spaced frequency samples: 


mega = linspace (0,2*pi*(1-1/N), N)'; 
Sample the desired magnitude response and create h[n]: 
= 1.0*H d(Omega); h = real (ifft (H)); 


oe O 


To complete the design, the filter length must be specified. Small values of N reduce the filter's complexity but also reduce the quality of 
the filter's response. Large values of N improve the approximation of Hg(Q) but also increase complexity. A balance is needed. We 
choose an intermediate value of N = 21 and use MS9P2 to design the filter. 

>> N = 21; h = MS9P2 (N, H_d); 


To assess the filter quality, the frequency response is computed by means of program MS5P1. 

>> Omega = linspace (0, 2*pi, 1000); samples = linspace (0,2*pi*(1-1/N),N)'; 

>> H = MS5SP1 (h,1, Omega); 

>> subplot (2,1,1); stem ([0:N-1],h,'k'); xlabel ('n'); ylabel ('h[n]'); 

>> subplot (2,1,2); 

>> plot (samples, Hd (samples),'ko', Omega, H d(Omega), 'k:',Omega,abs (H),'k"'); 
>> axis ([0 2*pi -0.1 1.6]); xlabel ('\Omega'); ylabel ('|H(\Omega)|'); 

>> legend('Samples', 'Desired', 'Actual',0); 


As shown in Fig. M9.3, the filter's frequency response intersects the desired response at the sampled values of Hg(Q). The overall 
response, however, has significant ripple between sample points that renders the filter practically useless. Increasing the filter length 
does not alleviate the ripple problems. Figure M9.4 shows the case N = 41. 
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Figure M9.4: Length-41 FIR lowpass filter using zero phase. 


To understand the poor behavior of filters designed with MS9P2, remember that the impulse response of an ideal lowpass filter is a sinc 
function with the peak centered at zero. Thought of another way, the peak of the sinc is centered at n = 0 because the phase of Hg(Q) 
is zero. Constrained to be causal, the impulse response of the designed filter still has a peak at n = O but it cannot include values for 
negative n. As a result, the sinc function is split in an unnatural way with sharp discontinuities on both ends of h[n]. Sharp 
discontinuities in the time domain appear as high-frequency oscillations in the frequency domain, which is why H(Q) has significant 
ripple. 


To improve the filter behavior, the peak of the sinc is moved to n = (N — 1)/2, the center of the length-N filter response. In this way, 
the peak is not split, no large discontinuities are present, and frequency-response ripple is consequently reduced. With DFT properties, 
a cyclic shift of (N — 1)/2 in the time domain requires a scale factor of e JQ(N-1)2 in the frequency domain.!t] Notice that the scale 
factor eJO(N—-1)/2 affects only phase, not magnitude, and results in a linear phase filter. Program MS9P3 implements the procedure. 


function [h] = MS9P3 (N,H d); 

% MS9P3.m : MATLAB Session 9, Program 3 

% Function M-file designs a length-N FIR filter by sampling the desired 

% magnitude response H. Phase is defined to shift h[n] by (N-1)/2. 

% INPUTS: N = desired FIR filter length 

& H_d = inline function that defines the desired magnitude response 


% OUTPUTS: h = impulse response (FIR filter coefficients) 
% Create N equally spaced frequency samples: 

Omega = linspace (0,2*pi* (1-1/N),N)'; 

% Sample the desired magnitude response: 

H = H d (Omega); 

% Define phase to shift h[n] by (N - 1)/2: 

H = H.*exp(-j*Omega*( (N-1) / 2)); 

H(fix (N/2) + 2:N,1) = H(f£ix(N/2) +2:N, 1) * ((-1)*(N-1)); 
h- 


real (ifft (H)); 


Figure M9.5 shows the results for the N = 21 case using MS9P3 to compute A[n]. As hoped, the impulse response looks like a sinc 
function with the peak centered at n = 10. Additionally, the frequency-response ripple is greatly reduced. With MS9P3, increasing N 
improves the quality of the filter, as shown in Fig. M9.6 for the case N = 41. While the magnitude response is needed to establish the 
general shape of the filter response, it is the proper selection of phase that ensures the acceptability of the filter's behavior. 
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Figure M9.6: Length-41 FIR lowpass filter using linear phase. 


To illustrate the flexibility of the design method, consider a bandpass filter with passband (1t/4<|Q|<tr/2). 


>> H_d = inline(['(mod (Omega, 2*pi)>pi/4) & (mod(Omega, 2*pi)<pi/2) +',. 
"(mod (Omega, 2*pi) >3*pi/2) & (mod (Omega, 2*pi)<7*pi/4)']); 


Figure M9.7 shows the results for N = 50. Notice that this even-length filter uses a fractional shift and is symmetric about n = 24.5. 
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Figure M9.7: Length-50 FIR bandpass filter using linear phase. 


Although FIR filter design by means of frequency sampling is very flexible, it is not always appropriate. Extreme care is needed for 
filters, such as digital differentiators and Hilbert transformers, that require special phase characteristics for proper operation. Additionally, 
if frequency samples occur near jump discontinuities of Hg(Q), rounding errors may, in rare cases, disrupt the desired symmetry of the 


sampled magnitude response. Such cases are corrected by slightly adjusting the location of problematic jump discontinuities or by 
changing the value of N. 


[tl Technically, the shift property requires (N — 1)/2 to be an integer, which occurs only for odd-length filters. The next-to-last line of 
program MS9P3 implements a correction factor, of sorts, that is required to accommodate the fractional shifts desired for even-length 
filters. The mathematical derivation of this correction is nontrivial and is not included here. Those hesitant to use this correction factor 
have an alternative: simply round (N — 1)/2 to the nearest integer. Although the rounded shift is slightly off center for even-length filters, 
there is usually little or no appreciable difference in the characteristics of the filter. Even so, true centering is desirable because the 
resulting impulse response is symmetric, which can reduce by half the number of multiplies required to implement the filter. 


PROBLEMS 


9.1.1 Find the discrete-time Fourier series (DTFS) and sketch their spectra |D,| and 2D, for 0 < r < No — 1 for the following 


periodic signal: 
x[n] = 4cos2.42n + 2sin3.27n 
9.1.2 Repeat Prob. 9.1-1 for x[n] = cos2.2T1n cos3.3Ttn. 


9.1.3 Repeat Prob. 9.1-1 for x[n] = 2 cos 3.211(n —3). 


9.1.4 Find the discrete-time Fourier series and the corresponding amplitude and phase spectra for the x[n] shown in Fig. P9.1- 
4. 


| x[n] 


tall lh tliat 


Figure P9.1-4 


n 


9.1.5 Repeat Prob. 9.1-4 for the x[n] depicted in Fig. P9.1-5. 
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Figure P9.1-5 


9.1.6 Repeat Prob. 9.1-4 for the x[n] illustrated in Fig. P9.1-6. 


[ute Hitter tt Ht Hn ae 


Figure P9.1-6 


9.1.7 An No-periodic signal x[n] is represented by its DTFS as in Eq. (9.8). Prove Parseval's theorem (for the DTFS), which 
states that 


- > lr = SO DP 


n=(No} r=(No) 


In the text [Eq. (9.60)], we obtain the Pareseval's theorem for DTFT. [Hint: If w is complex, then |w|? = ww*, and use 
Eq. (8.28).] 


9.1.8 Answer yes or no, and justify your answers with an appropriate example or proof. 
a. Is a sum of aperiodic discrete-time sequences ever periodic? 


b. Is a sum of periodic discrete-time sequences ever aperiodic? 


9.2.1 Show that for a real x[n], Eq. (9.29) can be expressed as 
1 bd 
x[n] = ~ | |X (Q)| cos (Qn + 2X (Q)) dQ 
T Jo 


This is the trigonometric form of the DTFT. 


9.2.2 A signal x[n] can be expressed as the sum of even and odd components (Section 1.5-1): 
x[n] = x.[n] + x,[n] 


a. If x[n] <= X(Q), show that for real x[n], 


x.[n] <=> Re[X(&2)] 


and 


xo[n] => fj Im[X(Q)] 

b. Verify these results by finding the DTFT of the even and odd components of the signal (0.8)"u[n]. 
9.2.3 For the following signals, find the DTFT directly, using the definition in Eq. (9.30). Assume |y| < 1. 

a. d[n] 

b. d[n — k] 

c. y"u[n — 1] 

d. y"u[n + 1] 

e. (—y)"u[n] 

f. ylal 


9.2.4 Use Eq. (9.29) to find the inverse DTFT for the following spectra, given only over the interval |Q|<tr. Assume Q,, and 
Oo <TT. 
: elk integer k 


b. cos k QO integer k 


c. cos?(Q/2) 


A 82 
d. 222, 


e. 277T6(O—-QO o) 


f. T[B(Q—O9)t8(ON+Q9)] 


9.2.5 Using Eq. (9.29), show that the inverse DTFT of rect ((Q—/4)11) is 0.5 sinc (tTtn/2)el™"™/4 
9.2.6 From definition (9.30), find the DTFT of the signals x[n] in Fig. P9.2-6. 


x[x] x[r] 


d@'{a<1) 


(b) 


(a) 
Figure P9.2-6 


9.2.7 From definition (9.30), find the DTFT of the signals depicted in Fig. P9.2-7. 


(a) (b) 
Figure P9.2-7 
9.2.8 Use Eq. (9.29) to find the inverse DTFT of the spectra (shown only for |Q| <) in Fig. P9.2-8. 


(a) {b) 
Figure P9.2-8 
9.2.9 Use Eq. (9.29) to find the inverse DTFT of the spectra (shown only for |Q|<tr) in Fig. P9.2-9. 
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Figure P9.2-9 


9.2.10 Find the DTFT for the signals shown in Fig. P9.2-10. 


| x[n] 


{c) (d) 


Figure P9.2-10 


9.2.11 Find the inverse DTFT of X(Q) (shown only for |Q|< tr) for the spectra illustrated in Fig. P9.2-11. [Hint: X(Q) = 
[X(Q)jel- XA), This problem illustrates how different phase spectra (both with the same amplitude spectrum) represent 


entirely different signals.] 
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Figure P9.2-11 


9.2.12 
a. Show that time-expanded signal x,[n] in Eq. (3.4) can also be expressed as 
oO 
x,[n] = x x[k]3[n — Lk] 
&k=—00 
b. Find the DTFT of x.[n] by finding the DTFT of the right-hand side of the equation in part (a). 
c. Use the result in part (b) and Table 9.1 to find the DTFT of [n], shown in Fig. P9.2-12. 
z[n] 
l 
eee eee 
* > a ied ee > iid .<e * 
9 6 3 0 3 6 9 ——/ 
Figure P9.2-12 
9.2.13 


a. A glance at Eq. (9.29) shows that the inverse DTFT equation is identical to the inverse (continuous-time) 
Fourier transform Eq. (7.8b) for a signal x(t) bandlimited to tr rad/s. Hence, we should be able to use the 
continuous-time Fourier transform Table 7.1 to find DTFT pairs that correspond to continuous-time 
transform pairs for bandlimited signals. Use this fact to derive DTFT pairs 8, 9, 11, 12, 13, and 14 in 


Table 9.1 by means of the appropriate pairs in Table 7.1. 


b. Can this method be used to derive pairs 2, 3, 4, 5, 6, 7, 10, 15, and 16 in Table 9.1? Justify your answer 


with specific reason(s). 
9.2.14 Are the following frequency domain signals valid DTFT's? Answer yes or no, and justify your answers. 
a. X(Q) = O+Tt 
b. X(Q) =j +17 
c. X(Q) = sin(10Q) 
d. X(Q) = sin(Q/10) 
e. X(Q) = 8(Q) 


9.3.1 Using only pairs 2 and 5 (Table 9.1) and the time-shifting property (9.52), find the DTFT of the following signals, 


assuming |a| < 1 
a. u[n] — u[n — 9] 
b. a"—™u[n — ml] 
c. a?~3(u[n] — u[n —10]) 
di; a" -™ufn] 


e. a"u[n — m] 


f. (n — mja”~™u[n — m] 
g. (n — m)ja"u[n] 
h. na"~™u[n—-m] 
9.3.2 The triangular pulse x[n] shown in Fig. P9.3-2a is given by 
Tr) 


ltt. eri thie 


‘ — 


elie. TTT. 


ts) iu 


lM. 


Figure P9.3-2 
Ae iS _ Sei52 4 eiM 
(eJ® — 1} 


Use this information and the DTFT properties to find the DTFT of the signals x4[n], xg[n], x3[n], and x4[n] shown in 
Fig. P9.3-2b, P9.3-2c, P9.3-2d, and P9.3-2e, respectively. 


9.3.3 Show that periodic convolution XX (82) ¥(Q) = 2m X (22) it 
4 
X(Q) = Soa e Aka 


k=0 


X(2) = 


and 


i 4 
¥(2) = SACL) ,- 20 


sin(&2 /2) 


where ax is a set of arbitrary constants. 


9.3.4 Using only pair 2 (Table 9.1) and properties of DTFT, find the DTFT of the following signals, assuming |a| < 1 and Qo 
<TT. 


a. a” cos Oo nu [n] 
b. na" u[n] 
c. (n— k) a2" u[n— ml 


9.3.5 Use pair 10 in Table 9.1, and some suitable property or properties of the DTFT, to derive pairs 11, 12, 13, 14, 15, and 
16. 


9.3.6 Use the time-shifting property to show that 
x[n +k] + x[n — k] <> 2X(Q) coskQ 


Use this result to find the DTFT of the signals shown in Fig. P9.3-6. 
x(n] 
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» 


Figure P9.3-6 


9.3.7 Use the time-shifting property to show that 
x[a +k] —x[n —k] > 2jX(Q) sinkQ 


Use this result to find the DTFT of the signal shown in Fig. P9.3-7. 
x[n] 


on Ii A arereeee 


Figure P9.3-7 


9.3.8 Using only pair 2 in Table 9.1 and the convolution property, find the inverse DTFT of X(Q) = e2/2/(ei@ — y)2. 


9.3.9 In Table 9.1, you are given pair 1. From this information and using some suitable property or properties of the DTFT, 
derive pairs 2, 3, 4, 5, 6, and 7 of Table 9.1. For example, starting with pair 1, derive pair 2. From pair 2, use suitable 
properties of the DTFT to derive pair 3. From pairs 2 and 3, derive pair 4, and so on. 


9.3.10 From the pair el(Bo/2yn <>» 2a § ($2 — (829 /2)) over the fundamental band, and the frequency-convolution property, 
find the DTFT of e/9°". Assume Qo > 71/2. 


9.3.11 From the definition and properties of the DTFT, show that 


~ 
5 sinc(Q.n)=— Qe<x 
Q, 


a. n=—co 


be «) 
>. (—1)"sinc (Q.n)=0 Q.<2 
b. Aa=S—oO 


oe) 


- 7 
S> sinc?(Qen) = SQ. < x/2 


c 
C. r=—co 


>; (-1)"sine?(Q.n) =0 Q.<2/2 


d. A=—OO 


* sin(M&2/2 
am $2 /2) =2n odd 
e. J_» sin(&2/2) 
x 
se sinc (Q.n)|* = 27/32, 2. <2/2 
f. t=—co 


9.3.12 Show that the energy of signal x,(t) specified in Eq. (9.73) is identical to T times the energy of the discrete-time signal 
x[n], assuming x,(t) is bandlimited to B = 1/2T Hz. [Hint: Recall that sinc functions are orthogonal, that is, 


OD 
' sinc [w(t — m)] sinc [z(t —n)] at 


oo 
0 mn 
l m=n 


9.4.1 Use the DTFT method to find the zero-state response y[n] of a causal system with frequency response 
e/@ 4 0.32 
H(Q) = ———_——_ 
eF28 + ei28 + 0.16 
and the input 


x[n] = (—0.5)" ula] 
9.4.2 Repeat Prob. 9.4-1 for 


H(Q) = os a 
eJ28 + ej? + 0.16 
and input 
x[a] = u[n] 
9.4.3. Repeat Prob. 9.4-1 for 


eit 


and 
x[n] = 0.8" u[n] + 2(2)"u[—(n + 1)] 


9.4.4 An accumulator system has the property that an input x[n] results in the output 
a 


ya] = > xfk] 


k=-00 
a. Find the unit impulse response hA[n] and the frequency response H(Q) for the accumulator. 
b. Use the results in part a to find the DTFT of u[n]. 
9.4.55 AnLTID system frequency response over |Q| 


22 59 
A (82) = ret( 2) 
x 


Find the output y[n] of this system, if the input x[n] is given by 
a. sinc (trn/2) 


b. sinc (tn) 
c. sinc? (1rn/4) 


9.4.6 
a. If x[n] <= X(Q), then, show that (—1)"x[n] = xX(Q — Tr). 


b. Sketch y”u[n] and (—y)"u[n] for y = 0.8; see the spectra for y"u[n] in Fig. 9.4b and 9.4c. From these 
spectra, sketch the spectra for (—y)"u[n]. 


——— 


v[n] 


H(Q) 
Figure P9.4-7 ar 
2 cos Dn cos Qn 
HA) 
yn] yin] 
>_> 
H&M 
2sin fhm sin {270 
Figure P9.4-9 


c. An ideal lowpass filter of cutoff frequency QO, is specified by the frequency response H(Q) = rect (Q/20,). 
Find its impulse response h[n]. Find the frequency response of a filter whose impulse response is 


9.4.7 


9.4.8 


9.4.9 


9.m.1 


9.m.2 


9.m.3 


(—1)"h[n]. Sketch the frequency response of this filter. What kind of filter is this? 


A filter with impulse response h[n] is modified as shown in Fig. P9.4-7. Determine the resulting filter impulse response 
h4[n]. Find also the resulting filter frequency response H,(Q) in terms of the frequency response H(Q). How are H(Q) 


and H4(Q) related? 


a. 


Consider an LTID system Sj, specified by a difference equation of the form of Eqs. (3.17a) or (3.17b) or 
(3.24) in Chapter 3. We construct another system So by replacing coefficients a; (/ = 0, 1, 2, ..., N) by 
coefficients (—1)!a; and replacing all coefficients b; (i = 0, 1, 2, ...,N) with coefficients (—1)'b;. How are the 
frequency responses of the two systems related? 


. If S4 represents a lowpass filter, what kind of filter is specified by So? 


. What type of filter (lowpass, high-pass, etc.) is specified by the difference equation 


y[n] — 0.8y[n — 1] = x[n] 


What kind of filter is specified by the difference equation 
y[n] + O.8y[n — 1] = x[n] 


. The system shown in Fig. P9.4-9 contains two identical LTID filters with frequency response H9(Q) and 


corresponding impulse response ho[n]. It is easy to see that the system is linear. Show that this system is 
also time invariant. Do this by finding the response of the system to input 5[n — k] in terms of ho[n]. 


. If Ho(Q) = rect (O/2W) over the fundamental band, and O, + W <, find H(Q), the frequency response of 


this system. What kind of filter is this? 


This problem uses a matrix-based approach to investigate the computation of the inverse DTFS. 


Cc. 


. Implement Eq. (9.8), the inverse DTFS, using a matrix-based approach. 


. Compare the execution speed of the matrix-based approach to the IFFT-based approach for input vectors 


of sizes 10, 100, and 1000. 


What is the result of multiplying the DFT matrix Wyo by the inverse DTFS matrix? Discuss your result. 


A stable, first-order highpass IIR digital filter has transfer function 


H@=( 


9 


l+qa oS 


l—az! 
. Derive an expression relating « to the 3 dB cutoff frequency O.¢. 


. Test your expression from part a in the following manner. First, compute « to achieve a 3 dB cutoff 
frequency of 1 kHz, assuming a sampling rate of F, = 5 kHz. Determine a difference equation description 
of the system, and verify that the system is stable. Next, compute and plot the magnitude response of the 
resulting filter. Verify that the filter is highpass and has the correct cutoff frequency. 


. Holding « constant, what happens to the cutoff frequency QO, as Fg is increased to 50 kHz? What happens 
the cutoff frequency f, as Fg is increased to 50 kHz? 


. Is there a well-behaved inverse filter to H( )? Explain. 


. Determine o for OQ, = Tt/2. Comment on the resulting filter, particularly A[n]. 


Figure P9.M-3 provides the desired magnitude response |H(Q)| of a real filter. Mathematically, 


9.m.4 


9.m.5 


= 0.6 
= 
= 0.4 
0.2 
0 
T wr/2 0 a/2 7 
0 
Figure P9.M-3: Desired magnitude response |H(Q)J. 
4Q /a 0<2<7/4 
|H(Q)| = < 2—42/z m/4<Q<2n/2 
0) m/2<Q<z7 


Since the digital filter is real, |H(Q)| = |H(—Q)| and |H(Q)| = |H(Q + 2t1r)| for all O. 
a. Can a realizable filter have this exact magnitude response? Explain your answer. 


b. Use the frequency sampling method to design an FIR filter with this magnitude response (or a reasonable 
approximation). Use MATLAB to plot the magnitude response of your filter. 


A real FIR comb filter is needed that has magnitude response |H(Q)| = [0, 3, 0, 3, 0, 3, 0, 3] for O = [0, 11/4, 11/2, 3171/4, 
tT, 5101/4, 311/2, 711/4], respectively. Provide the impulse response h[n] of a filter that accomplishes these specifications. 


A permutation matrix P has a single one in each row and column with the remaining elements all zero. Permutation 
matrices are useful for reordering the elements of a vector; the operation Px reorders the elements of a column vector x 
based on the form of P. 


a. Fully describe an No x No permutation matrix named Rayo that reverses the order of the elements of a 
column vector x. 


b. Given DFT matrix Wyo, verify that (Wyjo)(Wyyo) = Wyo* produces a scaled permutation matrix. How does 


Wo2x reorder the elements of x? 


c. What is the result of (W)yo2)(Wyo2)x = Wyyo*x? 


Chapter 10: State-Space Analysis 


OVERVIEW 


In Section 1.10, basic notions of state variables were introduced. In this chapter, we shall discuss state variables in more depth. 


Most of this book deals with external (input-output) description of systems. As noted in Chapter 1, such a description may be inadequate in some 
cases, and we need a systematic way of finding a system's internal description. State-space analysis of systems meets this need. In this method, we 
first select a set of key variables, called the state variables, in the system. Every possible signal or variable in the system at any instant t can be 
expressed in terms of the state variables and the input(s) at that instant t. If we know all the state variables as a function of t, we can determine 
every possible signal or variable in the system at any instant with a relatively simple relationship. The system description in this method consists of 
two parts: 


1. A set of equations relating the state variables to the inputs (the state equation). 
2. A set of equations relating outputs to the state variables and the inputs (the output equation). 


The analysis procedure, therefore, consists of solving the state equation first, and then solving the output equation. The state-space description is 
capable of determining every possible system variable (or output) from knowledge of the input and the initial state (conditions) of the system. For this 
reason, it is an internal description of the system. 


By its nature, state variable analysis is eminently suited for multiple-input, multiple-output (MIMO) systems. A single-input, single output (SISO) 
system is a special case of MIMO systems. In addition, the state-space techniques are useful for several other reasons, mentioned in Section 1.10, 
and repeated here: 


1. The state equations of a system provide a mathematical model of great generality that can describe not just linear systems, but also 
nonlinear systems; not just time-invariant systems, but also time-varying-parameter systems; not just SISO systems, but also MIMO 
systems. Indeed, state equations are ideally suited for analysis, synthesis, and optimization of MIMO systems. 


2. Compact matrix notation along with powerful techniques of linear algebra greatly facilitate complex manipulations. Without such 
features, many important results of modern system theory would have been difficult to obtain. State equations can yield a great deal of 
information about a system even when they are not solved explicitly. 


3. State equations lend themselves readily to digital computer simulation of complex systems of high order, with or without nonlinearities, 
and with multiple inputs and outputs. 


4. For second-order systems (N = 2), a graphical method called phase-plane analysis can be used on state equations, whether they are 
linear or nonlinear. 


This chapter requires some understanding of matrix algebra. Section B.6 is a self-contained treatment of matrix algebra, which should be more than 
adequate for the purposes of this chapter. 


10.1 INTRODUCTION 


From the discussion in Chapter 1, we know that to determine a system's response(s) at any instant t, we need to know the system's inputs during its 
entire past, from (tm)co to t. If the inputs are known only for ¢t > fo, we can still determine the system output(s) for any t > fo, provided we know 
certain initial conditions in the system at t = to. These initial conditions collectively are called the initial state of the system (at t = fo). 


The state variables q(t), qo(t), .... an(t) are the minimum number of variables of a system such that their initial values at any instant fo are sufficient 
to determine the behavior of the system for all time t = fo when the input(s) to the system is known for t = tg. This statement implies that an output 
of a system at any instant is determined completely from a knowledge of the values of the system state and the input at that instant. 


Initial conditions of a system can be specified in many different ways. Consequently, the system state can also be specified in many different ways. 
This means that state variables are not unique. 


This discussion is also valid for multiple-input, multiple-output (MIMO) systems, where every possible system output at any instant t is determined 
completely from a knowledge of the system state and the input(s) at the instant t These ideas should become clear from the following example of an 
RLC circuit. 


EXAMPLE 10.1 


Find a state-space description of the RLC circuit shown in Fig. 10.1. Verify that all possible system outputs at some instant t can be determined from 
knowledge of the system state and the input at that instant ¢. 


Figure 10.1 


It is known that inductor currents and capacitor voltages in an RLC circuit can be used as one possible choice of state variables. For this reason, we 
shall choose q, (the capacitor voltage) and q2 (the inductor current) as our state variables. 


The node equation at the intermediate node is 
ig =t —in—Q 
but 3 = 0.2H, iy = 2(% — qi), be = 341. Hence 
0.24, = 2(x — qi) — 341 — Go 
or 
di = —25q; — 5q2 + 10x (10.1) 


This is the first state equation. To obtain the second state equation, we sum the voltages in the extreme right loop formed by C, L, and the 2 O 
resistor so that they are equal to zero: 


—H +42+2q2 =0 


or 
hr = — 242 (10.2) 
Thus, the two state equations are 
qh = —25q, — 5q2 + 10x (10.3) 
d2 = — 242 (10.3b) 
Every possible output can now be expressed as a linear combination of q1, gz, and x. From Fig. 10.1, we have 
yU=I—-h 
i, = 2x —q) 
R= 4 
ih= 341 
by = ty — 2 — G2 = 2X — Gy) — 31 — G2 = —Sqi — G2 + 2x 
is = 


vy = 2is = 2g2 
Us = qi — 4 = — 2a (10.4) 


This set of equations is known as the output equation of the system. It is clear from this set that every possible output at some instant t can be 
determined from knowledge of q4(t), q2(t), and x(t), the system state, and the input at the instant t, Once we have solved the state equations (10.3) 


to obtain q4(t) and qo(t), we can determine every possible output for any given input x(t). 


For continuous-time systems, the state equations are N simultaneous first-order differential equations in N state variables q1, q2, ..., dn Of the form 


Gi = BAGis Urs «+ <6 One M1, X25 ~~ Xy) fm 157, ons N (10.5) 

where x1, X92, ..., Xj are the / system inputs. For a linear system, these equations reduce to a simpler linear form 
Ge = AQ) FA ngs t+ Fay gn tO dy TO ake th DX, (m1,2,...,.N (10.64) 

If there are k outputs y1, yo, ..., Yk, the k output equations are of the form 


Vor ™ Cri * CuaGz + + Condy + Deg Xy + Iggy + + djX; m= I1,2,....k 
(10.6b) 


The N simultaneous first-order state equations are also known as the normal-form equations. 


These equations can be written more conveniently in matrix form: 


4 a M2 +> awl [a Dn Oi es by] xy 


q ay 42 +++ aw P bu bn - b; A 
ise | val Wl ied Co al Eb (10.7a) 
dw ay, Gyr +++ Gyn} [ay Dy, by2 ++ by; j 
OC? SO TO Or 
a A 4 B x 
and 
yy Cu Ce oe Cw) Tn dy diz sss diy] xy 
vy Ga Ges ete * Op " dy dy ++ dy} |x, 
Nols = 1 iSieles = Biss (10.7b) 
v1 Cy G2 +s: Cw) Law dy diz ++ dy} Us; 
een eee 
y « 4 Db 
or 
q = Aq + Bx (10.8a) 
y = Cq+ Dx (10.8b) 


Equation (10.8a) is the state equation and Eq. (10.8b) is the output equation; q, y, and x are the state vector, the output vector, and the input 
vector, respectively. 


For discrete-time systems, the state equations are N simultaneous first-order difference equations. Discrete-time systems are discussed in Section 
10.6. 


10.2 ASYSTEMATIC PROCEDURE FOR DETERMINING STATE EQUATIONS 


We shall discuss here a systematic procedure for determining the state-space description of linear time-invariant systems. In particular, we shall 
consider systems of two types: (1) RLC networks and (2) systems specified by block diagrams or Nth-order transfer functions. 


10.2-1 Electrical Circuits 
The method used in Example 10.1 proves effective in most of the simple cases. The steps are as follows: 
1. Choose all independent capacitor voltages and inductor currents to be the state variables. 
2. Choose a set of loop currents; express the state variables and their first derivatives in terms of these loop currents. 


3. Write loop equations, and eliminate all variables other than state variables (and their first derivatives) from the equations derived in 
steps 2 and 3. 


EXAMPLE 10.2 


Write the state equations for the network shown in Fig. 10.2. 


22 


Figure 10.2 


Step 1. There is one inductor and one capacitor in the network. Therefore, we shall choose the inductor current q1 and the capacitor voltage qz as 
the state variables. 


Step 2. The relationship between the loop currents and the state variables can be written by inspection: 


dq = ty (10.9a) 
Gp = in — is (10.9b) 
Step 3. The loop equations are 
4i, —2i. =x (10.10a) 
iz —h) +a +a =90 (10. 10b) 
—q2 + 3i3 = 0 (10.10c) 


Now we eliminate i1, i2, and iz from Eqs. (10.9) and (10.10) as follows. From Eq. (10.10b), we have 
i = 2, — bh) -— 


We can eliminate i, and iz from this equation by using Eqs. (10.9a) and (10.10a) to obtain 


h=-H-gQt zn 

The substitution of Eqs. (10.9a) and (10.10c) in Eq. (10.9b) yields 

G2 = 2q1 — $42 

These are the desired state equations. We can express them in matrix form as 


qj j-l ll) jm 


é 2 Q x (10.11) 
2 mo 6S 2 


S wie 


The derivation of state equations from loop equations is facilitated considerably by choosing loops in such a way that only one loop current passes 
through each of the inductors or capacitors. 


AN ALTERNATIVE PROCEDURE 
We can also determine the state equations by the following procedure: 


1. Choose all independent capacitor voltages and inductor currents to be the state variables. 


2. Replace each capacitor by a voltage source equal to the capacitor voltage, and replace each inductor by a current source equal to the 
inductor current. This step will transform the RLC network into a network consisting only of resistors, current sources, and voltage 
sources. 


3. Find the current through each capacitor and equate it to Chi, where q; is the capacitor voltage. Similarly, find the voltage across each 


inductor and equate it to Ld; , where qj; is the inductor current. 


EXAMPLE 10.3 
Use the three-step alternative procedure just outlined to write the state equations for the network in Fig. 10.2. 


In the network in Fig. 10.2, we replace the inductor by a current source of current q1 and the capacitor by a voltage source of voltage qz, as shown 
in Fig. 10.3. The resulting network consists of four resistors, two voltage sources, and one current source. We can determine the voltage v, across 
the inductor and the current i, through the capacitor by using the principle of superposition. This step can be accomplished by inspection. For 
example, v,; has three components arising from three sources. To compute the component due to x, we assume that q1 = 0 (open circuit) and q2 = 0 
(short circuit). Under these conditions, the entire network to the right of the 2 O resistor is opened, and the component of v; due to x is the voltage 
across the 2 O resistor. This voltage is clearly (1/2)x. Similarly, to find the component of v; due to q;, we short x and qz. The source q; sees an 
equivalent resistor of 1 QO across it, and hence v,; = —q4. Continuing the process, we find that the component of v, due to qz is —qz. Hence 


Figure 10.3: Equivalent circuit of the network in Fig. 10.2. 

Ue = Gi = 4X -Gi -— 4 (10.12a) 
Using the same procedure, we find 

be =} =H — 342 (10.12b) 


These equations are identical to the state equations (10.11) obtained earlier.[T] 


10.2-2 State Equations from a Transfer Function 


It is relatively easy to determine the state equations of a system specified by its transfer function.!"] Consider, for example, a first-order system with 
the transfer function 


H(s) = (10.13) 


S+a 
The system realization appears in Fig. 10.4. The integrator output q serves as a natural state variable since, in practical realization, initial conditions 
are placed on the integrator output. The integrator input is naturally Y. From Fig. 10.4, we have 
qQ=-—aq+x (10.14a) 
y=4q (10.14b) 


Figure 10.4 


In Section 4.6 we saw that a given transfer function can be realized in several ways. Consequently, we should be able to obtain different state-space 
descriptions of the same system by using different realizations. This assertion will be clarified by the following example. 


EXAMPLE 10.4 
Determine the state-space description of a system specified by the transfer function 
2s + 10 
H(s) = —— > (10.15a) 


s3 +85? + 19s + 12 


2 s+5 1 
AS 
(=) (3) (5) (10. 15b) 


4 2 2 
— +— (10.15c) 
S+ s+3 s+ 


We shall use the procedure developed in Section 4.6 to realize H(s) in Eq. (10.15) in four ways: (i) the direct form II (DFII), and (ii) the transpose of 
DFIl [Eq. (10.15a)], (iii) the cascade realization [Eq. (10.15b)], and (iv) the parallel realization [Eq. (10.15c)]. These realizations are depicted in Fig. 
10.5. As mentioned earlier, the output of each integrator serves as a natural state variable. 
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Figure 10.5: (a) Canonical, (b) transpose, (c) cascade, and (d) parallel realizations of the system. 


DIRECT FORM II AND ITS TRANSPOSE 


Here we shall realize the system using the canonical form (direct form II and its transpose) discussed in Section 4.6. If we choose the state variables 
to be the three integrator outputs qj, gz, and q3, then, according to Fig. 10.5a, 


N= 
= 4s (10.16a) 
G3 = —12q, — 1992 — 893 + x 
Also, the output y is given by 
y = 10g; + 242 (10.16b) 


Equations (10.16a) are the state equations, and Eq. (10.16b) is the output equation. In matrix form we have 


qh 0 l 0 aq 0 
q| =| 0 0 l q2| + |O} x (10.17a) 
q -12 -19 y F 1 
— i 
and 
qi 
y=[10 2 O]]@ (10.17b) 
——_ ee” 
c q3 


We can also realize H(s) by using the transpose of the DFIl form, as shown in Fig. 10.5b. If we label the output of the three integrators as the state 
variables U1, U2, and U3, then, according to Fig. 10.5b, 


vb, = —12v; + 10x 
v2 = Vv; — 19v3 + 2x (10.18a) 


va = Us — 8v3 


and the output y is given by 


y= (10.18b) 
Hence 
vy 0 0 -12 Vv) 10 
bt} =]1 O —19} Jus} +] 2) 2x (10.19a) 
U3 01 -8 U5 0 
—_ <<» —— 
A BR 
and 
v) 
y=[0 0 1]}» (10.19b) 
eee! 
é U3 


Observe closely the relationship between the state-space description of H(s) by means of the DFIl realization [Eqs. (10.17)] and that from the 
transpose of DFIl realization [Eqs. (10.19)]. The A matrices in these two cases are the transpose of each other; also, the B of one is the transpose 
of C in the other, and vice versa. Hence 


(A)' =A 
(B)' = € (10.20) 
(C)’ =B 


This is no coincidence. This duality relation is generally true.[1] 


CASCADE REALIZATION 
The three integrator outputs w1, w2, and w3 in Fig. 10.5c are the state variables. The state equations are 


wy) = —w, +x (10.21a) 


Ww, = 2u, — 3w» (10.21b) 


W3 = Su. + Ww. — 40; (10.21c) 
and the output equation is 
y= ws (10.22) 
Upon eliminating > from Eq. (10.21c) by means of Eq. (10.21b), we convert these equations into the desired state form 
wy, -1 0 0 wy | 
w.}=}2 -3 O w>} + |Ol x (10.23a) 
W3 2 2 4 _ F 
and 
Wy 
y=[0 0 I] |u (10.23b) 
W4 


PARALLEL REALIZATION (DIAGONAL REPRESENTATION) 
The three integrator outputs z;, Z2, and z3 in Fig. 10.5d are the state variables. The state equations are 


4 =—-Z+2% 

Zo = —322 +X 

Z3 = —423 +X (10.24a) 
and the output equation is 

y = $21 — 222 + 325 (10.24b) 
Therefore, the equations in the matrix form are 

2 —1 0 0 Zz l 

2} =|0 3 O Z2| + [1] x (10.25a) 

23 0 O —4] [zs 1 


ym (? <2 9] (10.25b) 


ial 
i) 


COMPUTER EXAMPLE C10.1 


Use MATLAB to determine the first canonical form (DFl) for the system given in Example 10.4. 


Caution [MATLAB's convention for labeling state variables q1, q2, ..., dn in a block diagram, such as shown in Fig. 10.5a, is reversed. That is, 
MATLAB labels qj aS gn, J2 and gp_4, and so on.] 


>> num = [2 10]; den = [1 8 19 12]; 
>> [A,B,C,D] = tf2ss (num, den) 
A= -8 -19 =12 

1 0 0 

0 1 0 

B= 1 

0 

0 

C= 0 2 10 

D= 0 


It is also possible to determine the transfer function from the state space representation. 
>> [num, den] = ss2tf(A,B,C,D); 
>> tf(num, den) 


Transfer function: 
4.441e-015 s*2 + 2s + 10 


s*3 + 8 s*2 +19 s + 12 


A GENERAL CASE 

It is clear that a system has several state-space descriptions. Notable among these are the variables obtained from the DFIl, its transpose, and the 
diagonalized variables (in the parallel realization). State equations in these forms can be written immediately by inspection of the transfer function. 
Consider the general Nth-order transfer function 


_ bos + bys¥-! +--+ + by is + by 


Blah 10.2 
is sX + aysX-) +--+ + awias + an (10.26a) 
~  (§ =A Ms — Aa) +++ (8 — Aw) 
k k k; 
S—-Ar S—Ad a 


The realizations of H(s) found by using direct form II [Eq. (10.26a)] and the parallel form [Eq. (10.26b)] appear in Fig. 10.6a and 10.6b, respectively. 
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Figure 10.6: (a) Direct form II and (b) parallel realizations for an Nth-order LTIC system. 


The N integrator outputs q4, 92, .-..gx in Fig. 10.6a are the state variables. By inspection of this figure, we obtain 


qi = 
92 = 93 
(10.27a) 
Gr-1 =n 
Gn = —OnQ; — An-142 — +++ — Q2Gy-1 — Hdn +% 
and output y is 
y = bya + by-1g2 + +++ + bidn + bodn (10.27b) 


We can eliminate dw by using the last equation in the set (10.27a) to yield 


y = (by — boay)qy + (by -y — Boay-s)q2 + +++ + (by — Boa gw + box 
= byai + by-1a2 +--+ + bray + box (10.27¢) 


where b; =b; - bod, 


or 
a 0 1 0 0 0 n 0 
q 0 0 1 0 Ol|]@ 0 
ae-1 0 0 0 0 1 | lanes 0 
ay —G@y —Qy.1 —@y-2 -*- -& -@ qn 1 
and 
7 
2 
y=[by bys +--+ Bll. | +box (10.28b) 
Qn 


In Fig. 10.6b, the N integrator outputs z;, Zo, ...,Z_ are the state variables. By inspection of this figure, we obtain 


™=Aiz+x 


Z2 = Aol2 +X 


(10.29a) 
Zn =Awzw +X 
and 
y = kz, + kota +--+ + kwzw + Dox (10.29b) 
or 
zy A, O 0 oO zi 1 
Z2 0 dA» 0 0 22 1 
ml: of es : : : [+ ]ilx (10.30a) 
in-1 0 O «+ Ayy O Zn-1 1 
iw 0 O -:-- 0 Aw in 1 
and 
Zz 
yolk ke --+ kw kw] | ft | +dox (10.30b) 
ZN-1 
in 


Observe that the diagonalized form of the state matrix [Eq. (10.30a)] has the transfer function poles as its diagonal elements. The presence of 
repeated poles in H(s) will modify the procedure slightly. The handling of these cases is discussed in Section 4.6. 


It is clear from the foregoing discussion that a state-space description is not unique. For any realization of H(s) obtained from integrators, scalar 
multipliers, and adders, a corresponding state-space description exists. Since there are uncountable possible realizations of H(s), there are 
uncountable possible state-space descriptions. 


The advantages and drawbacks of various types of realization were discussed in Section 4.6. 


[tl This procedure requires modification if the system contains all-capacitor and voltage-source tie sets or all-inductor and current-source cut sets. In 
the case of all-capacitor and voltage-source tie sets, all capacitor voltages cannot be independent. One capacitor voltage can be expressed in terms 
of the remaining capacitor voltages and the voltage source(s) in that tie set. Consequently, one of the capacitor voltages should not be used as a 
state variable, and that capacitor should not be replaced by a voltage source. Similarly, in all-inductor current-source tie sets, one inductor should not 
be replaced by a current source. If there are all-capacitor tie sets or all-inductor cut sets only, no further complications occur. In all-capacitor voltage- 
source tie sets and/or all-inductor current-source cut sets, we have additional difficulties in that the terms involving derivatives of the input may 
occur. This problem can be solved by redefining the state variables. The final state variables will not be capacitor voltages and inductor currents. 


[‘lwe implicitly assume that the system is controllable and observable. This implies that there are no pole-zero cancellations in the transfer function. 
If such cancellations are present, the state variable description represents only the part of the system that is controllable and observable (the part of 
the system that is coupled to the input and the output). In other words, the internal description represented by the state equations is no better than 
the external description represented by the input-output equation. 


[]kKailath, Thomas. Linear Systems. Prentice-Hall, Englewood Cliffs, NJ, 1980. 


10.3 SOLUTION OF STATE EQUATIONS 


The state equations of a linear system are N simultaneous linear differential equations of the first order. We studied the techniques of solving linear 
differential equations in Chapters 2 and 4. The same techniques can be applied to state equations without any modification. However, it is more 
convenient to carry out the solution in the framework of matrix notation. 


These equations can be solved in both the time and frequency domains (Laplace transform). The latter is relatively easier to deal with than the time- 
domain solution. For this reason, we shall first consider the Laplace transform solution. 


10.3-1 Laplace Transform Solution of State Equations 


The ith state equation [Eq. (10.6a)] is of the form 
h = Gadi + Gig? 4 + indy & bax, & DiaXy 0 + Dx; (10.31a) 


We shall take the Laplace transform of this equation. Let 
qi(t) << > QO;(s) 


so that 


Gilt) <=> sQ;(s) — q,(0) 
Also, let ; 
xi(t) <=> Xi(s) 


The Laplace transform of Eq. (10.31a) yields 


SQi(s) — qi(O) = air Qi (5) + G2 Q2{s) + +++ + ain Qn (s) + Di Xi (5) 
+ bi2Xa(s) +--+ + dy Xj(s) (10.31b) 


Taking the Laplace transforms of all N state equations, we obtain 


Qi(s) q(0) 4; G2 **> Gy Qy(s) 
‘ik “| qi(0) ay 432 *** Aww] | Qx(s) 
LQu(sr) Lavo) cl a F Q@y2 *** Gynw Lows) 
“wn —“T0. Si ~—— 
bu Dye i Xi(s) 
ba by ++ Xy 2(8) (10328) 
Lom _bwa += bus] bys x, lx) 
—— 
Defining the vectors, as indicated, we have 
sQ(s) — q(0) = AQ(s) + BX(s) 
or 
sQ(s) — AQ(s) = q(0) + BX(s) 
and 
(sI — A)Q(s) = x(0) + BX(s) (10.32b) 
where | is the N x N identity matrix. From Eq. (10.32b), we have 
Q(s) = (sI — A)~'[q(0) + BX(s)] (10.33a) 
= @(s)[q(0) + BX(s)] (10.33b) 
where 
@(s) = (sI— A)" (10.34) 
Thus, from Eq. (10.33b), 
Q(s) = &(s)q(0) + B(s)BX(s) (10.35a) 
and 
q(t) = £7'[(s)]q(0) + £-'[@(s)BX(s)] (10.35b) 
SES 


Zero-inpul Componcat 7ero-sime component 


Equation (10.35b) gives the desired solution. Observe the two components of the solution. The first component yields q(t) when the input x(t) = 0. 


Hence the first component is the zero-input component. In a similar manner, we see that the second component is the zero-state component. 


EXAMPLE 10.5 
Find the state vector q(t) for the system whose state equation is given by 
q= Aq+ Bx 


where 


—_12 2 Ps 
A= | | B= yl x(t) = u(t) 
—-36 —1 1 


and the initial conditions are q4(0) = 2, q2(0) = 1. 


From Eq. (10.33b), we have 
Q(s) = &(s)[q(0) + BX(s)] 


Let us first find 6 (s). We have 


(sI-A)=s 10) |-2 $1] _ 
: ~" 10 1 a ae 


and 


sit 23 
&(s) = (sI— A) = — ° al (10.36a) 
Now, q(0) is given as 
0) = 
q(0) 1 
Also, X(s) = 1/s, and 
Tee 
BX(s) a 3 otra 3s 
1| s 4 
s 
Therefore 
241 6541 
q(0)+BX(s)=] *} =| * 
co a 


and 
Q(s) = &(s)[q(0) + BX(s)] 


-_ (s+4)(8+9) (s+4)(s+9) 3s 
~ | 336 _set2_ | | sit 
(s+4)(54+9) (s+4)(s+9) 5 
2s?+35+1 
_ | s6s+-4+9) 
i” s—59 
(s4+-4)(5+9) 
1/36 __ 21/20 , 136/45 
_ s s+4 s49 
aos 4+ Sf 
s+9 


The inverse Laplace transform of this equation yields 


ni _ i. — He“ + Fe ™)utr) 


(10.36b) 
grt) (—Se-* + Se-™ utr) 


COMPUTER EXAMPLE C10.2 


Repeat Example 10.5 using MATLAB. [Caution: See the caution in Computer Example C10.1.] 


>> syms s 


>> A = [-12 2/3;-36 -1]; B = [1/3; 1]; qO = [2;1]; X = 1/s; 
>> q = ilaplace (inv(s*eye (2) -A) * (q0+B*xX) ) 
gq= 


[ 136/45*exp(-9*t) -21/20*exp(-4*t) +1/36] 
[ 68/5* exp (-9*t) -63/5*exp (-4*t) ] 


Next, a plot is generated of the state vector. 


>> t = (0:.01:2)'; q = subs (q); 
>> ql = q(l:length (t)); q2 = q(length (t) + l:end); 
>> plot (t, ql, 'k', t, q2, 'k--'); xlabel ('t'); ylabel ('Amplitude'); 


>> legend ('q 1(t)', Ho 2G) "De 


The plot is shown in Fig. C10.2. 


Amplitude 


a) 02040608 1 12141618 2 


t 


Figure C10.2 


THE OUTPUT 
The output equation is given by 


y = Cq+Dx 


and 


¥(s) = CQ(s) + DX(s) 
Upon substituting Eq. (10.33b) into this equation, we have 
Y¥(s) = C{®(s)[q(0) + Bx X(s)]} + DX(s) 


= CO&(s)q(O) +[(CH(s)B + DIX(s) (10.37) 
——S Se 
Zeforinpul response Tero-same response 


The zero-state response [i.e., the response Y(s) when q(0) = 0] is given by 


¥(s) = [C(s)B + D]X(s) (10.38a) 


Note that the transfer function of a system is defined under the zero-state condition [see Eq. (4.32)]. The matrix Cd(s) B + D is the transfer function 
matrix H(s) of the system, which relates the responses y1, Y2,...,Yk to the inputs x4, x2,...,Xj: 


H(s) = C&(s)B + D (10.38b) 
and the zero-state response is 
Y¥(s) = H(s)X(s) (10.39) 


The matrix H(s) is a k x j matrix (k is the number of outputs and j is the number of inputs). The jth element Hij(s) of H(s) is the transfer function that 
relates the output y;(t) to the input x;(t). 


EXAMPLE 10.6 
Let us consider a system with a state equation 


dmb bled +h lle coat 


and an output equation 


yy 1 0 0 0 
Nn x 
Yoj=i|1 1 +]1 0 i (10.40b) 
2 2 
vs} flo 2} fo 4 
In this case, 
60 ' 1 0 1 0 0 0 
A=|_, 4 B= | i Cail 1 D=/1 0 (10.40¢) 
cas 0 2 01 
and 
a 1 s+3 1 : 
&(s) = (sI—Ay' = [ - beara sed (10.41) 
2 s+3 (e+ Diss) «=e 2d 
Hence, the transfer function matrix H(s) is given by 
H(s) = C%(s)B+D 
1 0 #43 1 0 0 
ma Greed vied F q lio 
0 2| lamers amen Uo i, , 
s+4 i 
(e+ Tis 42) (s+ Dis42) 
= _ _ (10.42) 
%s—2) s° 45942 
G@+Dis+2) (s+Dis+2) 


and the zero-state response is 


Y¥(s) = H(s)X(s) 


Remember that the jjth element of the transfer function matrix in Eq. (10.42) represents the transfer function that relates the output yj(t) to the input 


x,(t). For instance, the transfer function that relates the output y3 to the input x2 is H32(s), where 


s? +55 +2 
(s + 1)(s +2) 


COMPUTER EXAMPLE C10.3 
Repeat Example 10.6 using MATLAB. 


H33(S) = 


>> A= [0 1; -2 -3]; B= [1 0; 1 1]; 

>> C = [1 0; 11; 0 2); D= [0 0;1 0;0 1]; 

>> syms s; H = simplify (C*inv (s*ey (2) -A) *B+D) 

H = 

[ (s+4) / (s*2+3*s+2), 1/ (s*2+3*s+2) ] 
(st4) / (st2), 1/ (s+2) ] 

[ 2*(-2+s) / (s%*2+3*st+2), (5*st+s*%24+2) / (s*2+3*s+t2) ] 


Transfer functions relating particular inputs to particular outputs can be obtained using the ss2tf function. 


>> disp ('Transfer function relating y 3 and x _2:') 
>> [num, den] = ss2tf(A, B, C, D, 2); t£ (num (3,:), den) 


Transfer function relating y 3 and x 2: 


Transfer function: 
s*2 +5 s + 2 


e°2 +364 2 


CHARACTERISTIC ROOTS (EIGENVALUES) OF A MATRIX 
It is interesting to observe that the denominator of every transfer function in Eq. (10.42) is (s + 1)(s + 2) except for H24(s) and H29(s), where the 


factor (s + 1) is canceled. This is no coincidence. We see that the denominator of every element of %(s) is |s | — A] because 9(s) = (s I — A)', 
and the inverse of a matrix has its determinant in the denominator. Since C, B, and D are matrices with constant elements, we see from Eq. (10.38b) 
that the denominator of ®(s) will also be the denominator of H(s). Hence, the denominator of every element of H(s) is |s | — Al], except for the 
possible cancellation of the common factors mentioned earlier. In other words, the zeros of the polynomial |s | — A| are also the poles of all transfer 
functions of the system. Therefore, the zeros of the polynomial |s | — A| are the characteristic roots of the system. Hence, the characteristic roots of 
the system are the roots of the equation 


lsI— A] =0 (10.43a) 
Since |s | — Al] is an Nth-order polynomial in s with N zeros A4, Ag, ..., Ay, We can write Eq. (10.43a) as 
jsI—A| = sN + as*- +++ + y_15 + Gy 
= (s —A,)(s — A2)-++(s —Aw) =0 (10.43b) 


For the system in Example 10.6, 


IsI— Al s 0 
sSi— = 
0 


s 


s -—1 | 
2 s+3 

=s? +3542 (10.44a) 
= (s + 1)(s +2) (10.44b) 


Hence 
A.=-l and Ao = 2 


Equation (10.43a) is known as the characteristic equation of the matrix A, and 4, ?2, ..., Ay, are the characteristic roots of A. The term eigenvalue, 
meaning "characteristic value" in German, is also commonly used in the literature. Thus, we have shown that the characteristic roots of a system are 
the eigenvalues (characteristic values) of the matrix A. 


At this point, the reader will recall that if ?4, ?2, ..., Ay, are the poles of the transfer function, then the zero-input response is of the form 


yo(t) = ce" + ce +++» + eye™ (10.45) 


This fact is also obvious from Eq. (10.37). The denominator of every element of the zero-input response matrix C(s)q(0) is |s | — A] = (s — Aq)(s - 
22) ...(S — Ay). Therefore, the partial fraction expansion and the subsequent inverse Laplace transform will yield a zero-input component of the form 
in Eq. (10.45). 


10.3-2 Time-Domain Solution of State Equations 


The state equation is 


q = Aq+ Bx (10.46) 
We now show that the solution of the vector differential Equation (10.46) is 
t 
q(t) = e“q(0) + ec“ Bx(r) dr (10.47) 
a 


Before proceeding further, we must define the exponential of the matrix appearing in Eq. (10.47). An exponential of a matrix is defined by an infinite 
series identical to that used in defining an exponential of a scalar. We shall define 


AP Ae At 
A I -Pht 4 4 deep Hee (10.48a) 
2! 3! n! 
SAR; 
=> — (10.48b) 
kt 
tad 
For example, if 
0 1 
A= 
2 1 
then 
0 1 a 
b alt Le (1049 
and 
A’? fo fo ye 2 ye le’ § 
a AF 5=[ Jé-[F A sane 
and so on. 


We can show that the infinite series in Eq. (10.48a) is absolutely and uniformly convergent for all values of t. Consequently, it can be differentiated or 
integrated term by term. Thus, to find (d/dt)e', we differentiate the series on the right-hand side of Eq. (10.48a) term by term: 


Png gp OE BE ; 
rl mE get ee (10.51a) 
APP Abe 

=alt+ar+ y + 31 | 

= Ae“ (10.51b) 
The infinite series on the right-hand side of Eq. (10.51a) also may be expressed as 
a ‘ 2,2 3,3 
ae = t+ ars “Ya | iad 

= eA 

Hence 

d 

— eM = Ae! = eA (10.52) 
Also note that from the definition (10.48a), it follows that 

ae | (10.53a) 
where 


If we premultiply or postmultiply the infinite series for eAt [Eq. (10.48a)] by an infinite series for eA! we find that 


(e~™")(e™") = (eM )(e“"’) = I (10.53b) 


In Section B.6-3, we showed that 
d dU dV 
ae ae tae 


Using this relationship, we observe that 


= -e “Ag+ e™*G (10.54) 


We now premultiply both sides of Eq. (10.46) by e Alto yield 


eq =e Aq + “Bx (10.55a) 
or 
e“qg—e™“Aq=e “Bx (10.55b) 
A glance at Eq. (10.54) shows that the left-hand side of Eq. (10.55b) is 
Al 
=—I¢ 
7 mi! ] 
Hence 
d Al Ar 
ane 1 =e Bx 
The integration of both sides of this equation from 0 to ¢ yields 
i 
eal! = [ e“'Bx(r) dt (10.56a) 
0 
or 
i 
e“ g(t) — q(0) = [ e~“"Bx(r) dr (10.56b) 
Hence 
f 
e“q=q(0) + | e“"Bx(r) dt (10.56c) 
0 


Premultiplying Eq. (10.56c) by eAt and using Eq. (10.53b), we have 


t | 
qi=  eq(0) + e*"OBx(r) dt (10.57a) 
— 0 


zero-inpul component 
Zero-state component 


This is the desired solution. The first term on the right-hand side represents q(t) when the input x(t) = 0. Hence it is the zero-input component. The 
second term, by a similar argument, is seen to be the zero-state component. 


The results of Eq. (10.57a) can be expressed more conveniently in terms of the matrix convolution. We can define the convolution of two matrices in 
a manner similar to the multiplication of two matrices, except that the multiplication of two elements is replaced by their convolution. 


For example, 


ce | . be | _ | Br HX * Bs) (1 * 2 + Xr * Bs) 
X, Xs 3 84 (X3 ¥ 2) +Xs¥B3) (X3 * Br + X4 * Bs) 


By using this definition of matrix convolution, we can express Eq. (10.57a) as 
q(t) = e“'q(0) + e” * Bx(r) (10.57b) 


Note that the limits of the convolution integral [Eq. (10.57a)] are from 0 to t. Hence, all the elements of eA? in the convolution term of Eq. (10.57b) 
are implicitly assumed to be multiplied by u(t). 


The result of Eqs. (10.57) can be easily generalized for any initial value of t. It is left as an exercise for the reader to show that the solution of the 
state equation can be expressed as 


i 


q(t) =e" ato) + | eA" Bx(t) dt (10.58) 


fo 


DETERMINING e“? 


The exponential e4 required in Eqs. (10.57) can be computed from the definition in Eq. (10.48a). Unfortunately, this is an infinite series, and its 
computation can be quite laborious. Moreover, we may not be able to recognize the closed-form expression for the answer. There are several 


efficient methods of determining eA? in closed form. It was shown in Section B.6-5 that for an N x N matrix A. 


e™ = Bol + BA + BoA? +--+ + ByAy'! (10.59a) 


=] = 
Bo tL Ay OF oe ght em 
Bi Lm Bm a en! 
Nt L Ay a wee Qe et 


and A1, Ag, ..-, An, are the N characteristic values (eigenvalues) of A. 

We can also determine e4‘ by comparing Eqs. (10.57a) and (10.35b). It is clear that 
e' = £"[@(s)] (10.59b) 
= £"'[(sl—A)"'] (10.59¢) 


Thus, e4! and (s) are a Laplace transform pair. To be consistent with Laplace transform notation, e“! is often denoted by ®(t), the state transition 
matrix (STM): 


eM = g(t) 


EXAMPLE 10.7 
Use the time-domain method to find the solution to the problem in Example 10.5. 


For this case, the characteristic roots are given by 
> 


s+12 4 


=s* + 13s +36 =(s +4)(s +9) =0 
36 s+1 


Jt-al=| 


The roots are A, = —4 and Ag = —9, so 

Bo) [1 -4]' fe] 1 [9e~* —4e-™ 
B| |1 9) Je-*| 5] e*—e™ 
and 


e* = Bol + BA 


= (2e-" — 4e-%)|! ° + (te — Le) “B 
’ 7 1 ae 7 ’ —36 -l 


(Se-* + Se-") Se —e”) 
= | 5 5 15 (10.60) 


%(-e~* ms ee") (fe . 3e7™) 
The zero-input component is given by [see Eq. (10.57a)] 


—e" + $e") Z(e* —e™) | 2 
e'q(0) = | 5 5 is 


mM aw -9 & ,-4 3-0 
B(-e* +e") (Se — Ze) | 


abe + Be Jul) 
| if 3 (10.61a) 


(“Be + Se-™)u(n) 
Note the presence of u(t) in Eq. (10.61a), indicating that the response begins at t = 0. 


The zero-state component is e*‘* Bx = [see Eq. (10.57b)], where 


1 1 
Bx = |? u(t) = sul) 
1 u(t) 
and 
guess (Ge*+fe™)u(t) Zle*—e™)u(t)] [tute 
 * Bx(f) = * 
B(-e* + eu) (Fe — Ze )Jute)| | ue) 


Note again the presence of the term u(t) in every element of eA? This is the cast because the limits of the convolution integral run from 0 to ¢t [Eqs. 
(10.56)]. Thus 


(—3e* + Se" )u(t)e tur) 2(e —e-™)u(r) # u(t) 
es Bx(t) = 


5 
S(-e * +e )u(t)*iu(t) ($e — 2e-™ u(t) eu(t) 
—ke* u(t) u(t) + 2e-* u(t) * u(t) 
~ |- ze“ u(t) * u(t) + Ze" u(t) * u(t) 


Substitution for the preceding convolution integrals from the convolution table (Table 2.1) yields 


| a 2 or 
—-g(l—e™ u(t) + £0 —e u(t) 
e“'+ Bx(t) = bss = | 


—3(1 —e™ u(t) + 3 (1 — eu) 


i i | 2 —-N 
t+ te! — 26-™ u(t) 
(35 + a Be") | (10.61b) 


3(e* — e-™ )u(t) 


The sum of the two components [Eq. (10.61a) and Eq. (10.61b)] now gives the desired solution for q(t): 


alt) (x — He + He ™)ule) (10.61¢) 
- - O1Cc 
(Be + Fe-™)u(t) 


This result confirms the solution obtained by using the frequency-domain method [see Eq. (10.36b)]. Once the state variables q; and qz have been 
found for ¢t = 0, all the remaining variables can be determined from the output equation. 


THE OUTPUT 
The output equation is given by 


y(t) = Cq(t) + Dx(e) 
The substitution of the solution for q [Eq. (10.57b)] in this equation yields 
y(t) = Cle“ q(0) + e“'* Bx(r)] + Dx(r) (10.62a) 


Since the elements of B are constants, 
e“'+ Bx(t) = eB * x(1) 


With this result, Eq. (10.62a) becomes 


y(t) = Cle‘ q(0) + eB * x(4)] + Dx) (10.62b) 


Now recall that the convolution of x(t) with the unit impulse 8(t) yields x(t). Let us define a j x j diagonal matrix 5(t) such that all its diagonal terms 
are unit impulse functions. It is then obvious that 


8(t) * x(t) = x(t) 

and Eq. (10.62b) can be expressed as 
y(t) = Cle“ q(0) + eB & x(t)] + D8(t) # x(r) (10.63a) 
= Ce“ q(0) + [Ce B + D8(1)] * x(t) (10.63b) 


With the notation ¢(t) for e', Eq. (10.63b) may be expressed as 


y(t) = Co(r)q(0) +[Cd(t)B + D8(r)] * x(r) (10.63c) 
oe a 
7eTOiNput resporse zeto-siade Tesponse 


The zero-state response, that is, the response when q(0) = 0, is 


y(t) = [CA(1)B + D8(r)] * x(2) (10.64a) 

= h(t) *« x(t) (10.64b) 
where 

h(t) = Cd(r)B + Dar) (10.65) 


The matrix h(t) is a k x j matrix known as the impulse response matrix. The reason for this designation is obvious. The i th element of h(t) is h(t), 
which represents the zero-state response y; when the input x,(f) = 8(f) and when all other inputs (and all the initial conditions) are zero. It can also 
be seen from Eq. (10.39) and (10.64b) that 

Lfh(t)] = H(s) 


EXAMPLE 10.8 


For the system described by Eqs. (10.40a) and (10.40b), use Eq. (10.59b) to determine eAt. 
b(t) =e =L' Hs) 


This problem was solved earlier with frequency-domain techniques. From Eq. (10.41), we have 


s43 


1 


= 1 | +1)(+2) (+1) +2) 
P(t) =L , : 

(s+1)(s+2) (s+1)(s +2) 
ac pe 

= 1 | s+l +2 s+1 s+2 

— cre ae eee 
s+1 s+2 s+1 542 

2e'-—e e'—e 
—2e*+2e% -e' +264 


The same result is obtained in Example B.13 (Section B.6-5) by using Eq. (10.59a) [see Eq. (B.84)]. 


Also, 8(t) is a diagonal j x j or 2 x 2 matrix: 
é(t) O 
b(t) = : 
O dt) 
Substituting the matrices (tf), (t), C,D, and B [Eq. (10.40c)] into Eq. (10.65), we have 


; . ; a) 
'-e% et—-e 4% 1 0 &(t) 0 
. . . +)1 0 ; 
—2e% +2674 =e ten 71 1 01 O  &(t) 


3e°'-—2e°™ o”* —¢e"? 
5(t) + 2e-™ em 


—6e"' +8e°% = $(t) — 2e-™ + 4e-™ 


1 0 
hi=]l 1 
2 


(10.66) 


The reader can verify that the transfer function matrix H(s) in Eq. (10.42) is the Laplace transform of the unit impulse response matrix h(t) in Eq. 
(10.66). 


10.4 LINEAR TRANSFORMATION OF STATE VECTOR 


In Section 10.1 we saw that the state of a system can be specified in several ways. The sets of all possible state variables are related-in other 
words, if we are given one set of state variables, we should be able to relate it to any other set. We are particularly interested in a linear type of 
relationship. Let q1, 92, ...@y and w4, Wo, ..., Wy be two different sets of state variables specifying the same system. Let these sets be related by 
linear equations as 


Wy = Pudi + Piog2 +-+* + Pingu 


W2 = Pudi + P2g2 + +++ + Pavgn (10.67a) 
Wy = Pui + Py2d2 +++ + Pywdn 
or 
wy Pues Pr Pin nN 
wa) _| Pu Pn Pas) |e (10.67b) 
Wy Ni PN2 Pxnj Lan 
—— 
w P qa 


Defining the vector w and matrix P as just shown, we can write Eq. (10.67b) as 


w= Pq (10.67c) 


and 
q= Pow (10.674) 


Thus, the state vector q is transformed into another state vector w through the linear transformation in Eq. (10.67c). 


If we know w, we can determine q from Eq. (10.67d), provided P~' exists. This is equivalent to saying that P is a nonsingular matrix!T] (|P| + 0). 
Thus, if P nonsingular matrix, the vector w defined by Eq. (10.67c) is also a state vector. Consider the state equation of a system 
q=Aq-+ Bx (10.68a) 


w=Pq (10.68b) 


then 


q=P"'w 

and 

q=P"'w 

Hence the state equation (10.68a) now becomes 


P ‘w= AP ‘w+ Bx 


or 
w = PAP-'w + PBx (10.68c) 
= Aw +Bx (10,68) 
where 
A =PAP™" (10,69a) 
and 
B=PB (10.69b) 


Equation (10.68d) is a state equation for the same system, but now it is expressed in terms of the state vector w. 


The output equation is also modified. Let the original output equation be 
y=Cq + Dx 
In terms of the new state variable w, this equation becomes 


y = C(P“'w) + Dx 


= Cw + Dx 
where 
C=cP (10.69c) 


EXAMPLE 10.9 


The state equations of a certain system are given by 


mle allel +b 
| - ke -3| la so 2 x(t) (10.70a) 


Find the state equations for this system when the new state variables w1 and w2 are 


wi =H +42 


w2=% — @Q2 
or 
w tr ij 
r-f Ie com 
Ww 1 1) lg 
According to Eq. (10.68d), the state equation for the state variable w is given by 
w= Aw + Bx 
where [see Eqs. (10.69)] 
~ 1 1 0 I ae i ie 
— pap-! — 
ascliiaa St | Ee 5 I 3 
-/ Me : j ‘ 
Pl a 
_{-2 0 
~~ |3 -1 
and 
o-w-|) “{DI- [4 
ee) ee 18 | 


Therefore 


lnLs -allel+ Lal 
w.} |3 —I lu, —1 aM) 


This is the desired state equation for the state vector w. The solution of this equation requires a knowledge of the initial state w(0). This can be 
obtained from the given initial state q(0) by using Eq. (10.70b). 


COMPUTER EXAMPLE C10.4 
Repeat Example 10.9 using MATLAB. 


>> A= [0 1; -2 -3]; B= [1l; 2]; 
>> P = [1 1;1 -1]; 

>> Ahat = P*A*inv (P), Bhat = P*B 
Ahat = -2 0 

3 =i 

Bhat = 3 

=1 

Therefore, 


BY sae [| EY DL 
w2| | 3 -1| lw» -1 


INVARIANCE OF EIGENVALUES 

We have seen that the poles of all possible transfer functions of a system are the eigenvalues of the matrix A. If we transform a state vector from q 
to w, the variables w1, Wo, ..., Wy are linear combinations of q1, q2, .... gy and therefore may be considered to be outputs. Hence, the poles of the 
transfer functions relating w1, W2, ..., Wy to the various inputs must also be the eigenvalues of matrix A. On the other hand, the system is also 
specified by Eq. (10.68d). This means that the poles of the transfer functions must be the eigenvalues of A. Therefore, the eigenvalues of matrix A 


remain unchanged for the linear transformation of variables represented by Eq. (10.67), and the eigenvalues of matrix A and matrix A(A = PAP“) 
are identical, implying that the characteristic equations of A and A are also identical. This result also can be proved alternately as follows. 


Consider the matrix P(s | — A)P™1. We have 
P(sI — A)P"' = PsIP“' — PAP™' = sPIP“' -A=sl—A 


Taking the determinants of both sides, we obtain 


(Pi|sI — A||P~'| = |sI—Al 
The determinants |P| and IP~*| are reciprocals of each other. Hence 
|si — A| = |s1—Al (10.71) 
This is the desired result. We have shown that the characteristic equations of A and A are identical. Hence the eigenvalues of A and A are identical. 


In Example 10.9, matrix A is given as 


be : 
A= 
it ie 


The characteristic equations is 


Ss -_ 4 

I—A| = =s*+3 2=0 

|s | cae s°+3s+ 

Also 

- —2 0O 

=|; ‘ 
and 
- s+2 0 

jt— Ai = | J=s+3042=0 

—3 s+il 


This result verifies that the characteristic equations of A and A are identical. 


10.4-1 Diagonalization of Matrix A 


For several reasons, it is desirable to make matrix A diagonal. If A is not diagonal, we can transform the state variables such that the resulting matrix 


Ais diagonal.!T] One can show that for any diagonal matrix A, the diagonal elements of this matrix must necessarily be 71, ?9, ..., Ay (the 
eigenvalues) of the matrix. Consider the diagonal matrix A: 


0 @ 0 0) 
ie | 
0 O O -++ ay 
The characteristic equation is given by 
(s — a) 0 0 --- 0 
0 S-—a) 0 -:- 0 
a—sje| 2 Pe tai 
0 0 Q --- (Ss —aw) 
or 


(s —a1)(8 — a2)-+-(s —an) =90 
Hence, the eigenvalues of A are a4, ao, ..., ay. The nonzero (diagonal) elements of a diagonal matrix are therefore its eigenvalues A, ?2, ..., An. 
We shall denote the diagonal matrix by a special symbol, A: 


M30 Oe OG 
0 A» 0) aA 0 

Als = 3 (10.72) 
6 0 6: =< fy 


Let us now consider the transformation of the state vector A such that the resulting matrix A is a diagonal matrix A. 


Consider the system 


q = Aq+ Bx 


We shall assume that 4, ?9, ..., Ay, the eigenvalues of A, are distinct (no repeated roots). Let us transform the state vector q into the new state 
vector z, using the transformation 


z=Pq (10.73a) 
Then, after the development of Eq. (10.68c), we have 
z = PAP"'z + PBx (10.73b) 
We desire the transformation to be such that PAP“! is a diagonal matrix A given by Eq. (10.72), or 
z= Az+Bx (10.73) 
Hence 
A = PAP"! (10.74a) 
or 
AP=PA (10.74b) 


We know A and A. Equation (10.74b) therefore can be solved to determine P. 


EXAMPLE 10.10 


Find the diagonalized form of the state equation for the system in Example 10.9. 


In this case, 
0 1 

a=[5 

We found Ay = —1 and Az = —2. Hence 
-1 0 

a=[5 


and Eq. (10.74b) becomes 

-1 Of] [pu Pr Pu Po||}o 1 
0 -2] |Pu Px Pu Pn||-2 -3 

Equating the four elements on two sides, we obtain 


—Py = —2pr (10.75a) 


—Pi2 = Pu — 3Pr (10.75b) 
—2pn = —2pn (10.75c) 
—2pn = Pu — 3pm (10.75d) 


The reader will immediately recognize that Eqs. (10.75a) and (10.75b) are identical. Similarly, Eqs. (10.75c) and (10.75d) are identical. Hence two 
equations may be discarded, leaving us with only two equations [Eqs. (10.75a) and (10.75c)] and four unknowns. This observation means that there 


is no unique solution. There is, in fact, an infinite number of solutions. We can assign any value to p44 and pz, to yield one possible solution. [Ti P14 
= ky and p24 = kg, then from Eqs. (10.75a) and (10.75c) we have p42 = k4/2 and poo = ko: 


k 4 
P=|_ b (10.75e) 


2 I 
P= 10.75f 
dl (10.751 
The transformed variables [Eq. (10.73a)] are 
- 9 * 
Zi} |? FY jay _ [2a tae (10.76) 
Z2 1 1} |@ a+hn 


Thus, the new state variables z; and Z2 are related to q, and q2 by Eq. (10.76). The system equation with z as the state vector is given by [see Eq. 
(10.73c)] 


z= Ax+Bx 
where 
s-~o- [7 IDI-b 
1 He 3 
Hence 
ill Pee ao. 
22 0 2) lz! 13 
or 
Z = —z71 + 4x 
Z2 = —2z2 + 3x (10.77b) 


Note the distinctive nature of these state equations. Each state equation involves only one variable and therefore can be solved by itself. A general 
state equation has the derivative of one state variable equal to a linear combination of all state variables. Such is not the case with the diagonalized 
matrix A. Each state variable z; is chosen so that it is uncoupled from the rest of the variables; hence a system with N eigenvalues is split into N 
decoupled systems, each with an equation of the form 

z; = A;z; + (input terms) 


This fact also can be readily seen from Fig. 10.7a, which is a realization of the system represented by Eq. (10.77). In contrast, consider the original 
state equations [see Eq. 10.70a)] 
di = G2 t+ x(t) 


G2 = —2q, — 3g2 + 2x(f) 


(a) (b> 


Figure 10.7: Two realizations of the second-order system. 


A realization for these equations is shown in Fig. 10.7b. It can be seen from Fig. 10.7a that the states z, and zo are decoupled, whereas the states 
q1 and qo (Fig. 10.7b) are coupled. It should be remembered that Fig. 10.7a and 10.7b are realizations of the same system _|T] 


COMPUTER EXAMPLE C10.5 
Repeat Example 10.10 using MATLAB. [Caution: Neither P nor B is unique.] 


>> A= [0 1; -2 -3]; B= [1; 2]; 
>> [V, Lambda] = eig (A); 

>> P= inv (V), Lambda, Bhat = P*B 
P= 2.8284 1.4142 

2.2361 2.2361 

Lambda = =]. 0 

0 =-2 

Bhat = 5.6569 

6.7082 

Therefore, 


a pass ai A m 
~ Iz| [2.2361 2.2361] |g} 


; A ie A h rn esoxal i miAndt 
=]. = x = AZ x 
22 QO 2 |Z 6.7082 
[t]This condition is equivalent to saying that all N equations in Eq. (10.67a) are linearly independent; that is, none of the N equations can be 


expressed as a linear combination of the remaining equations. 


[tlin this discussion we assume distinct eigenvalues. If the eigenvalues are not distinct, we can reduce the matrix to a modified diagonalized (Jordan) 
form. 


[tllf, however, we want the state equations in diagonalized form, as in Eq. (10. 30a), where all the elements of B matrix are unity, there is unique 
solution. The reason is that the equation B = PR=- PB, where all the elements of Bare unity, imposes additional constraints. In the present example, 
this condition will yield p44 = 1/2, p42 = 1/4, po1 = 4, and p22 = %. The relationship between z and q is then 


a= stig and m= 3g +5 


[tlHere we only have a simulated state equation; the outputs are not shown. The outputs are linear combinations of state variables (and inputs). 
Hence, the output equation can be easily incorporated into these diagrams. 


10.5 CONTROLLABILITY AND OBSERVABILITY 


Consider a diagonalized state-space description of a system 


z—Az+Bx (10.78a) 
and 
Y = Cz + Dx (10.78b) 


We shall assume that all N eigenvalues ?1, ?2, ..., Ay are distinct. The state equations (10.78a) are of the form 
Ze = DmZn + Deni Xi + Bm2X2 ++ + Bani Xj Maw A Qicnas N 


it Dis Burs Sinieny bmn (the mth row in matrix B) are all zero, then 


Zim se = Nain 


and the variable z,, is uncontrollable because z,, is not coupled to any of the inputs. Moreover, Z;, is decoupled from all the remaining (N — 1) state 
variables because of the diagonalized nature of the variables. Hence, there is no direct or indirect coupling of z,, with any of the inputs, and the 
system is uncontrollable. In contrast, if at least one element in the mth row of B is nonzero, Zp is coupled to at least one input and is therefore 
controllable. Thus, a system with a diagonalized state [Eqs. (10.78)] is completely controllable if and only if the matrix B has no row of zero 
elements. 


The outputs [Eq. (10.78b)] are of the form 
j 
We = Cuts + Ciaz2 +++: + Ciwzn + > duXm >) 
mal 
If €jm = 0, then the state z,, will not appear in the expression for y;. Since all the states are decoupled because of the diagonalized nature of the 


equations, the state z,, cannot be observed directly or indirectly (through other states) at the output y;. Hence the mth mode edmt will not be 
observed at the output yj. If C4, Com, «» Gxm (the mth column in matrix C) are all zero, the state z,, will not be observable at any of the k outputs, 
and the state, z,, is observable. In contrast, if at least one element in the mth column of € is nonzero, Zm is observable at least at one output. Thus, 


a system with diagonalized equations of the form in Eqs. (10.78) is completely observable if and only if the matrix C has no column of zero elements. 
In this discussion, we assumed distinct eigenvalues; for repeated eigenvalues, the modified criteria can be found in the literature. [1], [2] 


If the state-space description is not in diagonalized form, it may be converted into diagonalized form using the procedure in Example 10.10. It is also 
possible to test for controllability and observability even if the state-space description is in undiagonalized form.1], [2] 


EXAMPLE 10.11 
Investigate the controllability and observability of the systems in Fig. 10.8. 


y 


1 4 s do > 
4 a 
¥ ¥ 
1 1 + Pd 1 


(a) 


. de 
1 
¥ 
q 


Figure 10.8 


In both cases, the state variables are identified as the two integrator outputs, gq; and qz. The state equations for the system in Fig. 10.8a are 


g=atx 
Qg=n-d (10.79) 
and 
Y=h@-hM=hn - MD 
Hence 
A=|) "| B=|)| C=[l -2] D=0 
1 -l 0 
s-—1 
si Al =), ey afTO—DG+D 
Therefore 
A=1 and A2=-1 
and 
1 O 
a=|) ‘ (10.80) 


We shall now use the procedure in Section 10.4-1 to diagonalize this system. According to Eq. (10.74b), we have 
p 0 | Pel _ Pe Pel ; " 
0 -I 21 22 21 Pnill —-l 


The solution of this equation yields 


P2=90 and = —2pn = pr 
Choosing p14 = 1 and p21 = 1, we have 
i 0 
P= 
1 -—2 
and 


l 
1 


smelt IE) 


All the rows of B are nonzero. Hence the system is controllable. Also, 


(10.81a) 


= Cz (10.81b) 
and 


-1 
€=cP'=[I ai A ={I al ‘)-" 1] (10.81¢) 


and 
2 


The first column of € is zero. Hence the mode z (corresponding to A, = 1) is unobservable. The system is therefore controllable but not observable. 
We come to the same conclusion by realizing the system with the diagonalized state variables z; and z2, whose state equations are 


z= Az+Bx 


y=Cz 

According to Eqs. (10.80) and (10.81), we have 
21=i2t+%x 

Z2 = —Za +X 

and 

yrXR 


Figure 10.9a shows a realization of these equations. It is clear that each of the two modes is controllable, but the first mode (corresponding to A = 1) 
is not observable at the output. 


Figure 10.9: Equivalents of the systems in Fig. 10.8. 


The state equations for the system in Fig. 10.8b are 


a=-qtx 
G2 = — a +42 = -2g1 +424+%X (10.82) 
and 
y= 
Hence 
-1 0 I 
= = =|0 1 D=0 
a= all el 
s+l1 
|sI — A] = [=6+D6-0 
—-1 s-1 


so that Ay = —1, Az = 1, and 


—1 0 
A= é 1 (10.83) 


Diagonalizing the matrix, we have 

0 i - _ i an a 4 

0 —I] [pu Pr 21 P22) |-2 1 

The solution of this equation yields p44 = —p42 and p22 = 0. Choosing p44 = —1 and p24 = 1, we obtain 


P= [Tg 


B = PB = B: a Hl = Hl (10.84a) 


C=cP"=/(0 1] és 


=f! 1] (10.84b) 


The first row of Bis zero. Hence the mode corresponding to A, = 1 is not controllable. However, since none of the columns of é vanish, both modes 
are observable at the output. Hence the system is observable but not controllable. 


We reach the same conclusion by realizing the system with the diagonalized state variables z; and zz. The two state equations are 
z= Az+Bx 

y=Cz 

From Eqs. (10.83) and (10.84), we have 


41 = 21 
Z2o=—-2+X 
and thus 


y=%2+ 2 (10.85) 


Figure 10.9b shows a realization of these equations. Clearly, each of the two modes is observable at the output, but the mode corresponding to A4 = 
1 is not controllable. 


COMPUTER EXAMPLE C10.6 


Repeat Example 10.11 using MATLAB. 


a. System from Fig. 10.8a. 


>> A = [1 0;1 -1]; = [1; 0]; C = [1 -2]; 
>> [V, Lambda] = eig(A); P=inv(V); 
>> disp('Part (a):'), Bhat = P*B, Chat = C*inv(P) 


Part (a): 

Bhat = -0.5000 
1.1180 

Chat = -2 0 


Since all the rows of Bhat (B) are nonzero, the system is controllable. However, one column of Chat (€) is zero, so one made is 
unobservable. 


b. System from Fig. 10.8b. 


>> A = [-1 0;-2 1]; B = [1; 1]; C = [0 1]; 

>> [V, Lambda] = eig(A); P=inv(V); 

>> disp('Part (b):'), Bhat = P*B, Chat = C*inv(P), 
Part (b): 

Bhat = 0 

1.4142 

Chat = 1.0000 0.7071 


One of the rows of Bhat (B) is zero, SO one mode is uncontrollable. Since all of the columns of Chat (C) are nonzero, the system is 
observable. 


10.5-1 Inadequacy of the Transfer Function Description of a System 


Example 10.11 demonstrates the inadequacy of the transfer function to describe an LTI system in general. The systems in Fig. 10.8a and 10.8b both 


have the same transfer function 
l 
H(s) = —— 
s+1 


Yet the two systems are very different. Their true nature is revealed in Fig. 10.9a and 10.9b, respectively. Both the systems are unstable, but their 
transfer function H(s) = 1/(s + 1) does not give any hint of it. Moreover, the systems are very different from the viewpoint of controllability and 
observability. The system in Fig. 10.8a is controllable but not observable, whereas the system in Fig. 10.8b is observable but not controllable. 


The transfer function description of a system looks at a system only from the input and output terminals. Consequently, the transfer function 
description can specify only the part of the system that is coupled to the input and the output terminals. From Fig. 10.9a and 10.9b we see that in 
both cases only a part of the system that has a transfer function H(s) = 1/(s + 1) is coupled to the input and the output terminals. This is why both 
systems have the same transfer function H(s) = 1/(s + 1). 


The state variable description (Eqs. 10.79 and 10.82), on the other hand, contains all the information about these systems to describe them 
completely. The reason is that the state variable description is an internal description, not the external description obtained from the system behavior 
at external terminals. 


Apparently, the transfer function fails to describe these systems completely because the transfer functions of these systems have a common factor s 
— 1 in the numerator and denominator; this common factor is canceled out in the systems in Fig. 10.8, with a consequent loss of the information. 
Such a situation occurs when a system is uncontrollable and/or unobservable. If a system is both controllable and observable (which is the case with 
most of the practical systems) the transfer function describes the system completely. In such a case the internal and external descriptions are 
equivalent. 


[21Zadeh, L., and C. Desoer. Linear System Theory. McGraw-Hill, New York, 1963. 


10.6 STATE-SPACE ANALYSIS OF DISCRETE-TIME SYSTEMS 


We have shown that an Nth-order differential equation can be expressed in terms of N first-order differential equations. In the following analogous 
procedure, we show that a general Nth-order difference equation can be expressed in terms of N first-order difference equations. 


Consider the z-transfer function 


doz + bz¥! + +++ + bw iz + bn 
Al(z2 = SF eee (10.86a) 
id ZY + aiz¥-! +--+ + awiiz +a 


The input x[n] and the output y[n] of this system are related by the difference equation 


(B* +a," +--+ ani E +ay)y[n] 
= (bo E® +b, EX +--+ + bw E + by)xIn] (10.86b) 


The DFIl realization of this equation is illustrated in Fig. 10.10. Signals appearing at the outputs of N delay elements are denoted by qy[n], q2[n], ..., 
qnin]. The input of the first delay is qj[n + 1]. We can now write N equations, one at the input of each delay: 


qin + 1] = gain] 
gain + 1] = gsin] 

: (10.87) 
gv-iln + 1) = quia} 


ania + 1] = —anqila] — ay-rqoia) —--+ — aquin] + x[a] 


a(n qnuin + 1] by yin 
—~— 


anln) 


nl 


qN-1 


a by 


| ee ee ee ee as 
il —e eee 


—ay alm be 


Figure 10.10: Direct form II realization of an Nth-order, discrete-time system. 


and 


y[n] = byailn) + by_iqgo[n] + --- + digw[n] + boqwiln] 
We can eliminate qj + 4[n] from this equation by using the last equation in the set (10.87) to yield 


yin] = (by — boa qi ln] + (by, — boay_ gain] + ++ - + (Dy — boa qin] + boxin] 
= byailn| + by-rarin| + +++ + brawlal + boxtnl (10.88) 


where b; = b; — boa. 


Equations (10.87) are N first-order difference equations in N variables qy[n], q2[n], ..., gn[n]. These variables should immediately be recognized as 
state variables, since the specification of the initial values of these variables in Fig. 10.10 will uniquely determine the response y[n] for a given x[n]. 
Thus, Eqs. (10.87) represent the state equations, and Eq. (10.88) is the output equation. In matrix form we can write these equations as 


qila+ i 0 ~ 0 ala} 0 
ex 1 en | gla) 0 
: ot >} ala] 
qx e+) 0 ~ 0 qv-s{a) 0 
Lavin + WY +1) —dy Si A io A —Qn.2 -** ~@ — kauted y 1 
- Pod 
a (10.89a) 
and 
gin] 
yin) = [by by. 6) | Pt + bp xm) (10.89b) 
¢ ~~ 
” qvin| 
In general, 
qin + 1] = Aqin] + Bx[n] (10.90a) 
y[n] = Cq[n] + Dx[n] (10.90b) 


Here we have represented a discrete-time system with state equations for DFIl form. There are several other possible representations, as discussed 
in Section 10.2. We may, for example, use the cascade, parallel, or transpose of DFIl forms to realize the system, or we may use some linear 
transformation of the state vector to realize other forms. In all cases, the output of each delay element qualifies as a state variable. We then write 
the equation at the input of each delay element. The N equations thus obtained are the N state equations. 


10.6-1 Solution in State-Space 


Consider the state equation 


qin + 1] = Aq[n] 4- Bx] (10.91) 
From this equation it follows that 

q{n] = Aq[n — 1] + Bx[n — 1] (10.92a) 
and 

q[n — 1] = Aq[n — 2] + Bx[n — 2] (10.92b) 

q[n — 2] = Aq[n — 3] + Bx[n — 3] (10.92c) 


a{1] = Aq[0] + Bx{0] 

Substituting Eq. (10.92b) in Eq. (10.92a), we obtain 

qin] = A’qin — 2] + ABx[n — 2] + Bx[n — 1] 

Substituting Eq. (10.92c) in this equation, we obtain 

qin] = A®qin — 3] + A°Bx[n — 3] + ABx[n — 2] + Bx[n — 1] 
Continuing in this way, we obtain 


ql] = A*q[0] + A”~'Bx[0] + A" 7 Bx{1] + +--+ Bx[n — 1] 


a-l 
= A"q[0]}+ >A"! "Bx{m] (10.93a) 


mad 
The upper limit on the summation in Eq. (10.93a) is nonnegative. Hence n = 1, and the summation is recognized as the convolution sum 


A” ufn — 1] * Bx{n] 


Consequently 
qin} = A” ql0)+ A” uln — 1) * Bx[n)} (10.93b) 
SS 
Zero input 7eTO state 
and 


y[n] = Cq + Dx 


a-l 
= CA"q[0] + 5> CA"! "Bx[m] + Dx (10.94a) 
m0 
= CA"q[0] + CA” ‘un — 1] « Bx[n] + Dx (10.94b) 
In Section B.6-5, we showed that 
A" = Bol + BA + BoA? +--+ By AN (10.95a) 
where (assuming WN distinct eigenvalues of A) 
fo} [tae ab ee a 
Bi; 1 de Bess AT] OL 
=|. P : 7 (10.95b) 
Nt 1 Aw AX + Aye? My 


and ?4, ?9, ....An are the N eigenvalues of A. 


We can also determine A” from the z-transform formula, which will be derived later, in Eq. (10.102): 


A* =2-'"(l—z"'A)"'] (10.95c) 
EXAMPLE 10.12 


Give a state-space description of the system in Fig. 10.11. Find the output y[n] if the input x[n] = u[n] and the initial conditions are q4[0] = 2 and 
q2[0] = 3. 


x[n] 


——f > 7 t 1] 


qin) —l 


nl 


Figure 10.11 


Recognizing that qz[n] = q4[n + 1], the state equations are [see Eq. (10.89)] 


qgin+t] [0 1] [qin) | 
gla + H 7 * 1 be Fhl* (10.96a) 
and 
qin] 
yin] = [-1 5] (10.96b) 
qin) 


To find the solution [Eq. (10.94)], we must first determine A”. The characteristic equation of A is 


Ae oth Seta(s t) (2 t) =0 
t a-3} 66 3 i 


|Al— Al = 


Hence, A; = 4 and ?9 = 1/2 are the eigenvalues of A and [see Eq. (10.95a)] 
A" = Bol + BiA 

where [see Eq. (10.95b)] 

Bo} fl 3 i (3)"] [3 2] [@*] _ | 3G)" -2(2)" 

Ai} | (3)"| |-6 6 | [(2y-"] | 603)" + 62)" 


and 


bole wt 


- 10 o | 
A”® = [(3(3)"" —2(2)"*] +[-6(3)" +6(2)"]] , 
0 1 a 


3(3)-" —2(2)-* —6(3)-* + 6(2)~" 
(10.97) 


(3)""—(2)"" ——- —2(3)"" +. 3(2)" 


We can now determine the state vector q[n] from Eq. (10.93b). Since we are interested in the output y[n], we shall use Eq. (10.94b) directly. Note 
that 


CA" =[-1 SJA* =[2(3)"—3(2)" —4(3)"" +9(2)""] (10.98) 


and the zero-input response is CA"q[0], with 


ql0] = 1 


3 
Hence, the zero-input response is 
CA"q{0] = —8(3)"" + 21(2)” (10.99a) 


The zero-state component is given by the convolution sum of CA"—tu[n — 1] and Bx[n]. We can use the shifting property of the convolution sum 


[Eq. (9.46)] to obtain the zero-state component by finding the convolution sum of CA"u[n] and Bx[n] and then replacing n with n — 1 in the result. 
We use this procedure because the convolution sums are listed in Table 3.1 for functions of the type x[n]u[n] rather than x[nJu[n — 1]. 


0 
CA* ulna] * Bx[n] = [2(3) * — 3(2) * — 4(3) -" + 9(2) "| * Bes 


= —4(3)" * ulna] + 9(2)™ *uln] 


Using Table 3.1 (pair 4), we obtain 


= (intl) 
—4 a ula] +9 


CA*uln] * Bx[n} st 
3 


(12 +6(3-""") = 18(2-""") Juin] 


Now the desired (zero-state) response is obtained by replacing n by n — 1. Hence 


CA" ufn] « Bx{n — 1] = [12 + 6(3)-" — 18(2)"" Jufn — 1) (10.99b) 
It follows that 


yln}] = [—8(3)-" + 21(2)""ufn] + [12 + 6(3)-" — 182)" Jul — 1) (10.100) 


This is the desired answer. We can simplify this answer by observing that 12 + 6(3)~" — 18(2)~" = 0 for n = 0. Hence, u[n — 1] may be replaced by 
u[n] in Eq. (10.99b), and 


y[n] = [12 — 2(3)™ + 3(2) "Juln] (10.100b) 


COMPUTER EXAMPLE C10.7 
Use MATLAB to find a graphical solution for Example 10.12. 


>> A = [0 1;-1/6 5/6]; B = [0; 1]; C = [-1 5]; D= 0; 

>> sys = ss(A,B,C,D,-1); % Discrete-time state space model 

>> N = 25; x = ones(1,N+1); n = (0:N); qO = [2;3]; 

>> [y,q] = lsim(sys,x,n,q0); % Simulate output and state vector 

>> clf; stem(n,y,'k'); xlabel('n'); ylabel('y[n]'); axis([-.5 25.5 11.5 13.5]); 


13.5 


13 


yin 
=) 
in 


Figure C10.7 


COMPUTER EXAMPLE C10.8 
Use MATLAB to plot the zero-state response of the system in Example 10.12. 


>> A [0 1;-1/6 5/6]; B = [0; 1]; C = [-1 5]; D= 0; 

>> N 25; x = ones(1,N+1); n = (0:N); 

>> [num,den] = ss2tf(A,B,C,D); 

>> y = filter (num,den,x); 

>> clf; stem(n,y,'k'); xlabel('n'); ylabel('y[n] (ZSR)"'); 
o> axis. 25.5: 0.5 12.5]) 7 


Similar to Computer Example C10.7, it is also possible to compute the output by using: 


>> A [0 1;-1/6 5/6]; B = [0; 1]; C = [-1 5]; D= 0; 

>> N 25; x = ones(1,N+1); n = (O:N); 

>> sys = ss(A,B,C,D,-1); y = lsim(sys,x,n); 

>> clf; stem(n,y,'k'); xlabel('n'); ylabel('y[n] (ZSR)'); 
o> axis ([H=sbd 2565 -0.5-12.5])4 


y[n] (ZSR) 


Figure C10.8 


10.6-2 The z-Transform Solution 


The z-transform of Eq. (10.91) is given by 
zQ[z] — zqf0] = AQ[z] + BX[z] 


Therefore 
(zI — A)Q[z] = zq[0] + BX[z] 
and 


Qlz] = (cl — A)~'zql0] + (21 — A)'BX{[z] 


= (1— z7'A)~'ql0] + (cl — A)"'BX{[z] (10.101a) 
Hence 
qin} = 2-(d — 2A)" IqlO] + 2-1(zl — A)" BXIzI] (10.101) 
ee — ” 
Zeto-iapul composcent Pero-state Component 
A comparison of Eq. (10.101b) with Eq. (10.93b) shows that 
A" = Z"[(I—z'A)“] (10.102) 


The output equation is given by 
¥[z] = CQ[z] + DX[z] 
= C{(l—z 'A)‘q[0} + (cl — A)'BX{z]] + DX{[z] 
= C(I = 2! A)~'q{0) + [C(I — A)-'B + DJX{z] 


=C(l—z A) 'qf0}+ H[z)X{z] (10.103a) 
—_—_—_— —_— 
7ero-inpal response FOTO ME TORPORSE 
where 
H[z] = C(zI— A)"'B+D (10.103b) 


Note that H[z] is the transfer function matrix of the system, and H,{z], the ith element of H[z], is the transfer function relating the output yj[n] to the 
input x;[n]. If we define h[n] as 


h{a) = Z~'{HIz]I 


then h[n] represents the unit impulse function response response matrix of the system. Thus, hylni, the ijth element of h[n], represents the zero-state 
response yj[n] when the input x;[n] = 8[n] and all other inputs are zero. 


EXAMPLE 10.13 
Use the z-transform to, find the response y[n] for the system in Example 10.12. 


According to Eq. (10.103a) 


tf wi" 6 
Y[z]}=[-1 5] b 1- A f 
62 62 


z(6e — 5) ia Seg cme 
Sse «Fa seaT| |2 —)(2- $+4) 
1 of HF) A) 9 PE 
6 —S241 | GF $2414 1)(2?- $244) 
_ 132°-32 (5z—1)z 
aa: ~ 1 as -2 3. 1 
Z—sc+i (2-1)(2?- 2242) 
—8z 2lz 12z 12z 6z 18z 
- 7 


Therefore 


y[n] = [—8(3)™ + 21(2)™ + 12 + 6(3) — 18(2)Jufn] 
cee ee | ne seems” 
zero-inpul response ZeTo-slule response 


LINEAR TRANSFORMATION, CONTROLLABILITY, AND OBSERVABILITY 
The procedure for linear transformation is parallel to that in the continuous-time case (Section 10.4). If w is the transformed-state vector given by 


w= Pq 


then 
win + 1] = PAP“'win] + PBx 


and 


y[n] = (CP"')w + Dx 


Controllability and observability may be investigated by diagonalizing the matrix, as explained in Section 10.4-1. 


10.7 SUMMARY 


An Nth-order system can be described in terms of N key variables-the state variables of the system. The state variables are not unique; rather, they 
can be selected in a variety of ways. Every possible system output can be expressed as a linear combination of the state variables and the inputs. 
Therefore the state variables describe the entire system, not merely the relationship between certain input(s) and output(s). For this reason, the state 
variable description is an internal description of the system. Such a description is therefore the most general system description, and it contains the 
information of the external descriptions, such as the impulse response and the transfer function. The state variable description can also be extended 
to time-varying-parameter systems and nonlinear systems. An external description of a system may not characterize the system completely. 


The state equations of a system can be written directly from knowledge of the system structure, from the system equations, or from the block 
diagram representation of the system. State equations consist of a set of N first-order differential equations and can be solved by time-domain or 
frequency-domain (transform) methods. Suitable procedures exist to transform one given set of state variables into another. Because a set of state 
variables is not unique, we can have an infinite variety of state-space descriptions of the same system. The use of an appropriate transformation 
allows us to see clearly which of the system states are controllable and which are observable. 
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MATLAB SESSION 10: TOOLBOXES AND STATE-SPACE ANALYSIS 


The preceding MATLAB sessions provide a comprehensive introduction to the basic MATLAB environment. However, MATLAB also offers a wide 
range of toolboxes that perform specialized tasks. Once installed, toolbox functions operate no differently from ordinary MATLAB functions. Although 
toolboxes are purchased at extra cost, they save time and offer the convenience of predefined functions. It would take significant effort to duplicate a 
toolbox's functionality by using custom user-defined programs. 


Three toolboxes are particularly appropriate in the study of signals and systems: the control system toolbox, the signal processing toolbox, and the 
symbolic math toolbox. Functions from these toolboxes have been utilized throughout the text in the Computer Exercises as well as certain homework 
problems. This session provides a more formal introduction to a selection of functions, both standard and toolbox, that are appropriate for state- 
space problems. 


M10.1 z-Transform Solutions to Discrete-Time State-Space Systems 


As with continuous-time systems, it is often more convenient to solve discrete-time systems in the transform domain rather than in the time domain. 
As given in Example 10.12, consider the state-space description of the system shown in Fig. 10.11. 


qila + 1] 0 sf (eal + (y] 2 
q2[n] I 


qin+1}}  |-4 


alw 


and 


yinj=t-1 5 |) 
q2{n] 


We are interested in the output y[n] in response to the input x[n] = u[n] with initial conditions q4[0] = 2 and q2[0] = 3. 


To describe this system, the state matrices A, B, C, and D are first defined. 
>> A= [0 1; -1/6 5/6]; B = [0; 1]; C = [-1 5]; D= 0; 


Additionally, the vector of initial conditions is defined. 
>> gq 0 = [2; 3]; 


In the transform domain, the solution to the state equation is 


Qiz] = (1 — z'A) 'ql0] + (zl — A)'BX{[z} (M10.1) 
The solution is separated into two parts: the zero-input component and the zero-state component. 


MATLAB's symbolic toolbox makes possible a symbolic representation of Eq. (M10.1). First, a symbolic variable z needs to be defined. 
>> z= sym ('z'); 


The sym command is used to construct symbolic variables, objects, and numbers. Typing whos confirms that z is indeed a symbolic object. The 
syms command is a shorthand command for constructing symbolic objects. For example, syms z s is equivalent to the two instructions z = sym 
('z');ands = sym ('s'); 

Next, a symbolic expression for X[z] needs to be constructed for the unit step input, x[n] = u[n]. The z-transform is computed by means of the 


ztrans command. 


>> X = ztrans (sym ('1')) 
X = z/(z-1) 


Several comments are in order. First the ztrans command assumes a causal signal. For n = 0, u[n] has a constant value of one. Second, the 
argument of ztrans needs to be a symbolic expression, even if the expression is a constant. Thus, a symbolic one sym ('1") is required. Also 
note that continuous-time systems use Laplace transforms rather than z-transforms. In such cases, the laplace command replaces the ztrans 
command. 


Construction of Q[z] is now trivial. 
>> QO = inv (eye (2) -z* (-1)*A) *q_0 + inv (z*eye(2) -A) *B*x 


6*z-5) *z/(6*z*2-5*zt+1)4+18*z/ (6*z*2-5*z4+1) +6*z/ (z-1) / (6*z*%2-5%*z+1) J 


Q= 
[2% 
-2*z/ (6*z*2-5*z4+1)4+18/ (6*z2*2-5*Z4+1) *z*24+6%*z%*2/ (z-1) / (6*z*2-5*z+1) ] 


[ 


Unfortunately, not all MATLAB functions work with symbolic objects. Still, the symbolic toolbox overloads many standard MATLAB functions, such as 
inv, to work with symbolic objects. Recall that overloaded functions have identical names but different behavior; proper function selection is typically 
determined by context. 


The expression Q is somewhat unwieldy. The simplify command uses various algebraic techniques to simplify the result. 
>> OQ = simplify(Q) 


2°2-5*Z+1) ] 


Q — 
[ 2*z* (6*z*2-2*z-1) / (z-1) / (6* 
a= Ly /(6sZ*2-5* Zl) J 


(z 
[ 2*z* (-7*z+1+9*z%2) /(z 
The resulting expression is mathematically equivalent to the original but notationally more compact. 


Since D = 0, the output Y[z] is given by Y[z] = CQ[z]. 


>> Y = simplify (C*Q) 
Y = 6*z* (13*z*2-11*z+2) /(z-1)/ (6*z*2-5*z+4+1) 


The corresponding time-domain expression is obtained using the inverse z-transform command iztrans. 


>> y = iztrans(Y) 
y = 12+3* (1/2) *n-2* (1/3) *n 


Like ztrans, the iztrans command assumes a causal signal so the result implies multiplication by a unit step. That is, the system output is y[n] = 
(12+3(1/2)" — 2('4)")u[n], which is equivalent to Eq. (10.100b) derived in Example 10.12. Continuous-time systems use inverse Laplace transforms 
rather than inverse z-transforms. In such cases, the ilaplace command therefore replaces the iztrans command. 

Following a similar procedure, it is a simple matter to compute the zero-input response yo[n]: 


>> y 0 = iztrans(simplify(C*inv(eye(2) -z*(-1)*A)*q_0)) 
yO0= 21* (1/2) *n-8* (1/3) “n 


The zero-state response is given by 


>> y-y_0 
ans = 12-18* (1/2) *n+6* (1/3) “n 


Typing iztrans (simplify (C*inv(z*eye(2) - A)*B*X)) produces the same result. 


MATLAB plotting functions, such as plot and stem, do not directly support symbolic expressions. By using the subs command, however, it is easy 
to replace a symbolic variable with a vector of desired values. 


>> n = [0:25]; stem(n, subs(y,n),'k'); xlabel('n'); ylabel('y[n]"'); 


Figure M10.1 shows the results, which are equivalent to the results obtained using program CE10 (7). Although there are plotting commands in the 
symbolic math toolbox such as ezplot that plot symbolic expression, these plotting routines lack the flexibility needed to satisfactorily plot discrete- 
time functions. 
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Figure M10.1: Output y[n] computed by using the symbolic math toolbox. 


M10.2 Transfer Functions from State-Space Representations 


A system's transfer function provides a wealth of useful information. From Eq. (10.103b), the transfer function for the system described in Example 
10.12 is: 


>> H = simplify (C*inv(z*eye (2) -A) *B+D) 
H = 6* (-14+5*z)/ (6*z*2-5*z+1) 


It is also possible to determine the numerator and denominator transfer function coefficients from a state-space model by using the signal processing 
toolbox function ss2tf. 


>> [num,den] = ss2tf (A,B,C,D) 
num = 0 5.0000 -1.0000 
den = 1.0000 -0.8333 0.1667 


The denominator of H[z] provides the characteristic polynomial 
2 5 i 
ere e 
Equivalently, the characteristic polynomial is the determinant of (z 1 — A). 


>> syms gamma; char poly = subs (det (z*eye (2) -A) ,z,gamma) 
char poly = gamma*2-5/6*gammat1/6 


Here, the subs command replaces the symbolic variable z with the desired symbolic variable gamma. 


The roots command does not accommodate symbolic expressions. Thus, the sym2poly command converts the symbolic expression into a 
polynomial coefficient vector suitable for the roots command. 


>> roots (sym2poly(char_poly) ) 

ans = 0.5000 

0..3333 

Taking the inverse z-transform of H[z] yields the impulse response hA[n]. 


>> h = iztrans (H) 
h = -6*charfcn[0] (n)+18* (1/2) *n-12* (1/3) “n 


As suggested by the characteristic roots, the characteristic modes of the system are (1/2)" and (4)". Notice that the symbolic math toolbox 
represents 5[n] as charfcn[0] (n). In general, 5[n — a] is represented as charfnc[a] (n). This notation is frequently encountered. Consider, 


for example, delaying the input x[n] = u[n] by 2, x[n — 2] = u[n — 2]. In the transform domain, this is equivalent to z2X{z]I. Taking the inverse z- 
transform of z’2X[z] yields: 


>> iztrans(z*(-2) *X) 
ans = -charfcn[1] (n)-charfcn[0] (n) +1 


That is, MATLAB represents the delayed unit step u[n — 2] as (—8[n — 1] — 8[n — 0] + 1)u[n]. 


The transfer function also permits convenient calculation of the zero-state response. 


>> iztrans (H*X) 
ans = -18* (1/2) *n+6* (1/3) *n+12 


The result agrees with previous calculations. 


M10.3 Controllability and Observability of Discrete-Time systems 


In their controllability and observability, discrete-time systems one analogous to continuous-time systems. For example, consider the LTID system 
described by the constant coefficient difference equation 


yin] + 2y[a — 1) + 4y[a — 2] = xin] + 4x0 - 1] 


Figure M10.2 illustrates the direct form II (DFIl) realization of this system. The system input is x[n], the system output is y[n], and the outputs of the 
delay blocks are designated as state variables q,[n] and qg[n]. 


6 
Figure M10.2: Direct form II realization of y[n]+(_ )y[n - 1]+(?)y[n - 2] = x[n]+(1/2)x[n — 1]. 


The corresponding state and output equations (see Prob. 10.M-1) are 


ine ti= e + 4 _ ° 1 we ‘ [}] st = agin) + Brin] 


qin +1) —2 —2| |qtn) 
and 
1,71 
vty (-2 =H] (SP) 4 rainy = conn + Data 
To describe this system in MATLAB, the state matrices A, B, C, and D are first defined. 
>> A = [0 1;-1/6 -5/6]; B = [0; 1]; Cc = [-1/6 -1/3]; D= 1; 


To assess the controllability and observability of this system, the state matrix A needs to be diagonalized_ It] As shown in Eq. (10.74b), this requires 
a transformation matrix P such that 


PA = AP (M10.2) 
where A is a diagonal matrix containing the unique eigenvalues of A. Recall, the transformation matrix P is not unique. 
To determine a matrix P, it is helpful to review the eigenvalue problem. Mathematically, an eigendecomposition of A is expressed as 
AV=VA (M10.3) 
where V is a matrix of eigenvectors and A is a diagonal matrix of eigenvalues. Pre-and post-multiplying both sides of Eq. (M10.3) by V~" yields 
vavv-'=Vv"'vav"! 


Simplification yields 
V'A=AV'! (M10.4) 
Comparing Eqs. (M10.2) and (M10.4), we see that a suitable transformation matrix P is given by an inverse eigenvector matrix vt. 


The eig command is used to verify that A has the required distinct eigenvalues as well as compute the needed eigenvector matrix V. 
>> [V,Lambda] = eig(A) 


V= 
0.9487 -0.8944 
-0.3162 0.4472 


Lambda = 
-0.3333 0 
0 -0.5000 


Since the diagonal elements of Lambda are all unique, a transformation matrix P is given by: 
>> P = inv(V); 


4 1 FR A = : : : ; : F 
The transformed state matrices A = PAP ©, B = PB ana é = cP are easily computed by using transformation matrix P. Notice that matrix D 
is unaffected by state variable transformations. 
>> Ahat = P*A*inv(P), Bhat = P*B, Chat = C*inv(P) 
Ahat = 
-0.3333 -0.0000 


0.0000 -0.5000 
Bhat = 


6.3246 
6.7082 


Chat = 
-0.0527 -0.0000 


The proper operation of P is verified by the correct diagonalization of A, A = A. Since no row of C = CP lis zero, the system is controllable. 
Since, however, at least one column of C is zero, the system is not observable. These characteristics are no coincidence. The DFIl realization, which 
is more descriptively called the controller canonical form, is always controllable but not always observable. 


As a second example, consider the same system realized using the transposed direct form II structure (TDFIl), as shown in Fig. M10.3. The system 
input is x[n], the system output is y[n], and the outputs of the delay blocks are designated as state variables vj[n] and v2[n]. 


x[n] 


ylr] 


Figure M10.3: Transposed direct form II realization of y[n] + ( )y[n — 1] + ( )y[n — 2] = x[n] + (1/2)x[n — 1]. 


The corresponding state and output equations (see Prob. 10.M-2) are 


u[n +1] (0 —£) [oti -§ 
V[a +1 = = + x[n] = AV[n] + Bx[n] 
v2{n + 1] [1 —3] [vole] — 
and 
v;[n] 
yin] = [0 1) + Ix[n] = CV[n] + Dx[n] 
v2[n] 
To describe this system in MATLAB, the state matrices A, B, C, and D are defined. 
>> A = [0 -1/6;1 -5/6]; B = [-1/6; -1/3]; C = [0 1]; D= 1; 


To diagonalize A, a transformation matrix P is created. 


>> [V,Lambda] = eig (A) 
V = 

0.4472 0.3162 
0.8944 0.9487 
Lambda = 

=, 3333 0 


0 -0.5000 


The characteristic modes of a system do not depend on implementation, so the eigenvalues of the DFII and TDFIl realizations are the same. 
However, the eigenvectors of the two realizations are quite different. Since the transformation matrix P depends on the eigenvectors, different 
realizations can possess different observability and controllability characteristics. 


‘ if Z 
Using transformation matrix P, the transformed state matrices A = PAP ’,B = PB and = cP“ are computed. 


>> P = inv(V); 
>> Ahat = P*A*inv(P), Bhat = P*B, Chat = C*inv(P) 


043333 0) 
0.0000 -0.5000 


Bhat = 
-0.3727 
-0.0000 


Chat = 
0.8944 0.9487 
Again, the proper operation of P is verified by the correct diagonalization of A, A = A. Since no column of € is zero, the system is observable. 


However, at least one row of Bis zero, and therefore the system is not controllable. The TDFIl realization, which is more descriptively called the 
observer canonical form, is always observable but not always controllable. It is interesting to note that the properties of controllability and observability 
are influenced by the particular realization of a system. 


M10.4 Matrix Exponentiation and the Matrix Exponential 


Matrix exponentiation is important to many problems, including the solution of discrete-time state-space equations. Equation (10.93b), for example, 


shows that the state response requires matrix exponentiation, A”. For a square A and specific n, MATLAB happily returns A” by using the * 
operator. From the system in Example 10.12 and n = 3, we have 


>> A = [0 1;-1/6 5/6]; n = 3; Atn 
ans = 

-0,.1389 0.5278 

-0.0880 0.3009 


The same result is also obtained by typing A*A*A. 


Often, it is useful to solve A” symbolically. Noting A” = ZK - z'A)- 1], the symbolic toolbox can produce a symbolic expression for A”. 


>> syms zon; An = simplify (iztrans (inv(eye(2) -z*(-1)*A))) 
An = 

[ =2° (Lenj+3° (lin), 6*2°(=n)-6"%3* (=n) J 

[ a2*(sn)+3“(-n), 3%2* (on)=2*3% (=n) ] 


Notice that this result is identical to Eq. (10.97), derived earlier. Substituting the case n = 3 into An provides a result that is identical to the one 
elicited by the previous A*n command. 


>> subs (An,n, 3) 
ans = 

-0.1389 0.5278 
-0.0880 0.3009 


For continuous-time systems, the matrix exponential et is commonly encountered. The expm command can compute the matrix exponential 
symbolically. Using the system from Example 10.7 yields: 


>> syms t; A = [-12 2/3;-36 -1]; eAt = simplify(expm(A*t) ) 


[ -3/5*exp (-4*t)+8/5*exp(-9*t), -2/15*exp(-9*t)+2/15*exp (-4*t) J 
[ 36/5*exp(-9*t) -36/5*exp(-4*t), 8/5*exp(-4*t) -3/5*exp (-9*t) | 


This result is identical to the result given in Eq. (10.60). Similar to the discrete-time case, an identical result is obtained by typing syms s; 


simplify(ilaplace(inv(s*eye(2)-A))). 


For a specific t, the matrix exponential is also easy to compute, either through substitution or direct computation. Consider the case tf = 3. 


>> subs (eAt,t, 3) 

ans = 1.0e-004 * 
-0.0369 0.0082 
-0.4424 0.0983 


The command expm(A*3) produces the same result. 


[tl This approach requires that the state matrix A have unique eigenvalues. systems with repeated roots require that state matrix A be transformed 
into a modified diagonal form, also called the Jordan form. The MATLAB function jordan is used in these cases. 


PROBLEMS 


10.1.1 Convert each of the following second-order differential equations into a set of two first-order differential equations (state equations). 
State which of the sets represent nonlinear equations. 


a. ¥+ 10V+2y=x 
b. ¥+2e%7 + logy =x 


c. + hi(y)i + hOyy =x 


10.2.1 Write the state equations for the RLC network in Fig. P10.2-1. 


Figure P10.2-1 


10.2.2 Write the state and output equations for the network in Fig. P10.2-2. 


gf 12 


Figure P10.2-2 


10.2.3. Write the state and output equations for the network in Fig. P10.2-3. 


; y - 


Figure P10.2-3 


10.2.4 Write the state and output equations for the electrical network in Fig. P10.2-4. 


Figure P10.2-4 


10.2.5 Write the state and output equations for the network in Fig. P10.2-5. 
1F 


Figure P10.2-5 


10.2.6 Write the state and output equations of the system shown in Fig. P10.2-6. 


at 


10.2.7. Write the state and output equations of the system shown in Fig. P10.2-7. 
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Figure P10.2-6 
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Figure P10.2-7 


10.2.8 For asystem specified by the transfer function 
3s + 10 
A@)= 


gs? +75 +12 
write sets of state equations for DFIl and its transpose, cascade, and parallel forms. Also write the corresponding output equations. 


10.2.9 Repeat Prob. 10.2-8 for 


4s 
ite=.——— 
, OO" GeDer a 
3 2 > 
HG) = StI +128 


~ (s+ 13(s + 2) 
10.3.1 Find the state vector q(t) by using the Laplace transform method if 
q = Aq+ Bx 


where 


9 
q) = Hl x(t) =0 
10.3.2 Repeat Prob. 10.3-1 for 


el Ce) ili 


a 
q(0) = A x(t} = sin 100t 


10.3.3 Repeat Prob. 10.3-1 for 
a-l|2 ° a |, 
tl =i ~ 10 
0 
q(0) = |‘ j x(t) =u(f) 


10.3.4 Repeat Prob. 10.3-1 for 


s=[o 2) =f 


l u(t) 
q(0) = A x= pel 


10.3.5 Use the Laplace transform method to find the response y for 


q = Aq + Bx(i} 
y = Cq+ Dx(t) 
where 


c=[0 1] D=0 


and 


2 
x(t) = u(t) q(0) = A 


10.3.6 Repeat Prob. 10.3-5 for 


10.3.7 


10.3.8 


10.3.9 


10.3.10 


10.3.11 
10.3.12 
10.3.13 
10.3.14 
10.3.15 
10.3.16 
10.3.17 
10.3.18 


10.3.19 
10.4.1 


10.4.2 


2 
x(t) = u(t) q(0) Hl 


The transfer function H(s) in Prob. 10.2-8 is realized as a cascade of H(s) followed by H2(s), where 


1 
a a s+3 
3s +10 
BY) = 


Let the outputs of these subsystems be state variables q1 and q2, respectively. Write the state equations and the output equation 
for this system and verify that H(s) = Cd(s)B + D. 


Find the transfer function matrix H(s) for the system in Prob. 10.3-5. 
Find the transfer function matrix H(s) for the system in Prob. 10.3-6. 


Find the transfer function matrix H(s) for the system 


q = Aq + Bx 
y = Cq+ Dx 
where 
0 l 0 1 ryt 
A= B= x= x(t) 
—-l —2 1 0 x2(t) 
1. 2 0 
C=/4 1 D=/]0 O 
1 1 1 0 


Repeat Prob. 10.3-1, using the time-domain method. 

Repeat Prob. 10.3-2, using the time-domain method. 

Repeat Prob. 10.3-3, using the time-domain method. 

Repeat Prob. 10.3-4, using the time-domain method. 

Repeat Prob. 10.3-5, using the time-domain method. 

Repeat Prob. 10.3-6, using the time-domain method. 

Find the unit impulse response matrix h(t) for the system in Prob. 10.3-7, using Eq. (10.65). 
Find the unit impulse response matrix h(t) for the system in Prob. 10.3-6. 


Find the unit impulse response matrix h(t) for the system in Prob. 10.3-10. 
The state equations of a certain system are given as 
qi = 42+ 2x 
G2 = —4 — Gr +x 


Define a new state vector w such that 
WwW} = q2 


W2=42—-% 


Find the state equations of the system with w as the state vector. Determine the characteristic roots (eigenvalues) of the matrix A in 
the original and the transformed state equations. 


The state equations of a certain system are 
nN=Q 


G2 = —24q, — 3q2 + 2x 


a. Determine a new state vector w (in terms of vector q) such that the resulting state equations are in diagonalized form. 


b. For output y given by 


y = Cq+ Dx 

where 
k «l 

c=| | D=0 
—-1 2 


determine the output y in terms of the new state vector w. 


10.4.3. Givena system 
0 | 0 


q=|]0 0 ILlq+{O|x 
0 -—2 -3 1 
determine a new state vector w such that the state equations are diagonalized. 


10.4.4 The state equations of a certain system are given in diagonalized form as 


-l1 0 0O 1 
q=|]0 -3 Of] q+]1lix 
0 0 —2 1 
The output equation is given by 
y=[1 3 Iq 
Determine ae output y for 


q(0) = |2 x() =u) 
| 


10.5.1 Write the state equations for the systems depicted in Fig. P10.5-1. Determine a new state vector w such that the resulting state 
equations are in diagonalized form. Write the output y in terms of w. Determine in each case whether the system is controllable and 


observable. 
. sta i y 
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Figure P10.5-1 
10.6.1 An LTI discrete-time system is specified by 


ol ae 


c=[0 1] De=Tf[ll] 


| x[n] = u[n] 


a. Find the output y[n], using the time-domain method. 
b. Find the output y[n], using the frequency-domain method. 


10.6.2 AnLTI discrete-time system is specified by the difference equation 
yln + 2] + y[n + 1) + 0.16y[n] 


= x[n + 1] + 0.32x[n] 
a. Show the DFIl, its transpose, cascade, and parallel realizations of this system. 


b. Write the state and the output equations from these realizations, using the output of each delay element as a state 
variable. 


10.6.3. Repeat Prob. 10.6-2 for 
yla + 2] + yln + 1] - 6y[a] 


= 2x[n + 2] + x[n + 1] 


10.m.1 ‘Verify the state and output equations for the LTID system shown in Fig. M.10-2. 


10.m.2 Verify the state and output equations for the LTID system shown in Fig. M.10-3. 
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of the discrete-time Fourier transform, 850-51, 860 
of the Fourier transform, 682, 700 


Conjugation, 682, 700 

Constant input, 203, 309 

Constant-parameter systems. See Time-invariant systems 
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torsional, 118, 119 


Data truncations, 746-51, 753-54 
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Laplace transform analysis of, 384-96, 467 
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highpass, 455, 456, 546, 726, 727, 875 
ideal. See Ideal filters 

impulse invariance criterion of, 554 
infinite impulse response, 529, 572-81 
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discrete-time. See Discrete-time Fourier transform 
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fast. See Fast Fourier transform 
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radian, 17, 94, 595 
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of the bilateral Laplace transform, 463 
of the discrete-time Fourier transform, 866-68 
of the Fourier transform, 712-14 
of the Laplace transform, 368 


Frequency differentiation, 861 
Frequency-division multiplexing (FDM), 711, 745 


Frequency domain analysis, 340, 378-79, 718-19, 840 
of electrical networks, 384-85, 386-87, 388 
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two-dimensional view and, 728-29 
See also Laplace transform 


Frequency inversion, 704 
Frequency resolution, 800, 803 


Frequency response, 720 
Bode plots and, 431-32 
of continuous-time systems, 423-29, 728, 729 
of discrete-time systems, 531-43 
MATLAB on, 468-69, 572-74 
periodic nature of, 537-41 
poles and zeros of H (s) and, 447-50 
from pole-zero location, 544-53 
pole-zero plots and, 572-74 
transfer function from, 446 
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Frequency shifting, 
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of the discrete Fourier transform, 812 
of the discrete-time Fourier transform, 863-66 
of the Fourier transform, 709-10 
of the Laplace transform, 363-64 


Frequency spectra, 600, 603 
Function M-files, 229-30 


Functions 
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even, 96-99, 130 
exponential, 94-96, 130 
improper, 26-27, 35 
inline, 131-33 


interpolation, 688 

MATLAB on, 131-38 

matrix, 46-47 

odd, 96-99, 130 

periodic. See Periodic functions 
proper, 26, 27, 28 

rational, 26, 27, 29, 348 
singularity, 93 

of square matrices, 46-47 

unit impulse. See Unit impulse function 
unit step. See Unit step function 


Fundamental band, 538, 539, 542, 787 
Fundamental frequency, 595, 611-12, 838 
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Gibbs, Josiah Willard, 620, 623 

Gibbs phenomenon, 616, 620-23, 661, 662-64 


Graphical interpretation 
of convolution integral, 179-92, 232-34 
of convolution sum, 294-99 
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Hardware realization, 68, 99, 129 

Harmonically related frequencies, 611 

Harmonic distortion, 635-36 

Heaviside, Oliver, 358-59, 614 

Heaviside "cover-up" method, 28-32, 34-35, 352, 353-54, 503 
Highpass filters, 455, 456, 546, 726, 727, 875 

Homogeneity. See Scaling 


H(s) 
filter design and, 446-56 
realization of, 554-55 
See also Transfer functions 
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Ideal differentiators, 381, 382, 427-28 

Ideal filters, 726-29, 753, 778, 780, 782, 783, 874-75 
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Ideal interpolation, 780-81 

Ideal linear phase (ILP), 721, 724 

Ideal masses, 117 
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Improper functions, 26-27, 35 

Impulse invariance criterion of filter design, 554 
Impulse matching, 166-68 

Impulse response matrix, 925 

Indefinite integrals, 50-51 

Indicator functions. See Relational operators 
Intertia, moment of, 118, 121 

Infinite impulse response (IIR) filters, 529, 572-81 
Information transmission rate, 220-21 

Initial conditions, 100-101, 345 


at 0 and 0*, 373-74 

classical solution and, 201 

continuous-time systems and, 160-62, 163 
generators of, 386-93 


Initial value theorem, 369-71, 515 
Inline functions, 131-33 


Input, 68 
complex, 179, 293 
constant, 203, 309 
exponential, 202-3, 309-11 
external. See External input 
in linear systems, 101 
multiple, 179, 294 
sinusoidal. See Sinusoidal input 
step, 419-21 


Input-output description, 113-21 
Instantaneous systems, 107, 130, 270 


Integrals 
convolution. See Convolution integral 
discrete-time Fourier, 847-59 
Fourier. See Fourier integral 
indefinite, 50-51 
of matrices, 43-45 

Integrators 
digital, 265-66 
ideal, 381, 428-29 
system realization and, 411 


Integro-differential equations, 371-84, 467, 494 


Interconnected systems 
continuous-time, 192-95 
discrete-time, 300-302 


Internal conditions 
continuous-time system response to, 152-64 
discrete-time system response to, 276-82 


Internal description of a system, 122-24, 131, 898. See also State-space description of a system 


Internal stability, 112, 131, 270 
BIBO relationship to, 211-14, 314-17 
of continuous-time systems, 209-14, 222, 226 
of discrete-time systems, 311, 312-17, 319, 531, 532 
of the Laplace transform, 382-84 
of the z-transform, 524 


Interpolation, 778-81 
of discrete-time signals, 250-52 
ideal, 780-81 
simple, 779-80 
spectral, 797 


Interpolation formula, 773, 781 
Interpolation function, 688 


Intuitive insights 
into continuous-time systems, 191-92, 215-23 
into discrete-time systems, 317-18 
into the Laplace transform, 377-79 


Inverse continuous-time systems, 194-95 

Inverse discrete Fourier transform (IDFT), 801, 821, 849 
Inverse discrete-time Fourier transform (IDTFT), 877 
Inverse discrete-time systems, 300-301 

Inverse Fourier transform, 681, 699-700, 753, 780 


Inverse Laplace transform, 340, 343, 345, 384, 554 
finding, 348-57 


Inverse z-transform, 494-95, 497, 524, 568 
finding, 501-6 
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matrix, 42-43 


Invertible systems, 112, 131, 269-70 
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Kirchhoff's laws, 99 
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Kronecker delta functions, 252-53 
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Lagrange, Louis de, 358, 614, 615 
Laplace, Marquis Pierre-Simon de, 357-58, 613, 614, 615 


Laplace transform, 168, 340-493, 717 
bilateral. See Bilateral Laplace transform 
differential equation solutions and, 371-84 
electrical network analysis and, 384-96, 467 
existence of, 346-47 
Fourier transform connection with, 697-98, 858 
intuitive interpretation of, 377-79 
inverse. See Inverse Laplace transform 
properties of, 360-71 
stability of, 381-84 
state equation solutions by, 912-19 
system realization and, 399-414, 467 
unilateral, 341, 343-46, 347, 456-58, 467 
z-transform connection with, 494, 495, 497, 560-62, 572 


Laplace transform pairs, 340-41, 343 
L-ary digital signals, 793 

Leakage, 747, 749-50, 751, 754, 800 
Left half plane (LHP), 96, 209, 210, 446 
Left shift, 76, 129, 509, 515, 516, 517 
Left-sided sequences, 564 

Legendre Fourier series, 655-56 
Leibniz, Gottfried Wilhelm, 795 
L'H6pital's rule, 48, 221, 688 

Linear convolution, 814 

Linear dashpots, 117 


Linearity 
of the bilateral Laplace transform, 462 
of the bilateral z-transform, 568 
concept of, 101-2 
of the discrete Fourier transform, 811, 818 
of the discrete-time Fourier transform, 859 
of discrete-time systems, 269 
of the Fourier transform, 684-85, 818 
of the Laplace transform, 341 
of the z-transform, 495 


Linear phase 
distortionless transmission and, 721, 873 
generalized, 724 
ideal, 721, 724 
physical description of, 705-7 
physical explanation of, 862 


Linear springs, 117 


Linear systems, 101-6, 130 
heuristic understanding of, 718-19 
response of, 102-4 


Linear time-invariant continuous-time (LTIC) systems. See Continuous-time systems 
Linear time-invariant discrete-time (LTID) systems. See Discrete-time systems 
Linear time-invariant (LTI) systems, 107, 196-97 

Linear time-varying systems, 107 

Linear transformation of vectors, 37, 926-34, 948 

Log magnitude, 433, 434-38 


Loop currents 
continuous-time systems and, 160-62, 163-64, 198, 206 
Laplace transform and, 386 


Lower sideband (LSB), 734, 735, 742-44 


Lowpass filters, 455, 456, 546 
ideal, 726, 778, 780, 782, 783, 874-75 
poles and zeros of H(s) and, 450-51 


Maclaurin series, 6, 48 
Magnitude response. See Amplitude response 


Marginally stable systems, 
continuous-time, 209, 210, 211, 214, 222, 226 
discrete-time, 312, 314, 319 
Laplace transform, 383 
signal transmission and, 717 
z-transform, 524 


Mathematical models of systems, 99 


MATLAB 
calculator operations in, 54-56 
on continuous-time filters, 468-78 
on discrete Fourier transform, 822-29 
on discrete-time Fourier series and transform, 881-89 
on discrete-time systems/signals, 320-25 
elementary operations in, 53-64 
Fourier series applications in, 662-68 
Fourier transform topics in, 754-60 
on functions, 131-38 
on infinite-impulse response filters, 572-81 
matrix operations in, 60-63 
M-files in, 227-34 
partial fraction expansion in, 63-64 
simple plotting in, 57-59 
state-space analysis in, 949-57 
vector operations in, 56-57 


Matrices, 37-48 
algebra of, 39-43 
characteristic equation of, 45-47, 919 
characteristic roots of, 918-19 
definitions and properties of, 38-39 
derivatives and integrals of, 43-45 
diagonal, 38 
diagonalization of, 930-31 
equal, 38 
functions of, 46-47 
identity, 38 
impulse response, 925 
inversion of, 42-43 
MATLAB operations, 60-63 
nonsingular, 43 
square 37, 38, 42-43, 45, 46-47 
state transition, 922 
symmetric, 38 
transpose of, 39 
zero, 38 


Matrix exponentials, 956-57 
Matrix exponentiation, 956-57 


Mechanical systems, 117-21 
Memoryless systems. See Instantaneous systems 
Method of residues, 28 


M-files, 227-34 
function, 229-30 
script, 227-29, 230 


Michelson, Albert, 622-23 
Minimum phase systems, 446 
Modified partial fractions, 36-37, 501-3 


Modulation, 711-12, 732-46 
amplitude, 710, 732, 737-42, 753 
angle, 732, 753 
of the discrete-time Fourier transform, 864-66 
double-sideband, suppressed-carrier, 732-37, 738, 742-44 
pulse-amplitude, 790 
pulse-code, 790, 793 
pulse -position, 790 
pulse-width, 790 
single-sideband, 742-45 


Moment of inertia, 118, 121 

Monotonic exponentials, 22-23, 94, 95, 96, 130 
Multiple-input, multiple-output (MIMO) systems, 102, 128, 898 
Multiple inputs, 179, 294 


Multiplication 
bilateral z-transform and, 568, 569 
of complex numbers, 12-14 
discrete-time Fourier transform and, 861 
of a function by an impulse, 91 
matrix, 40-41 
scalar, 40, 410-11, 512 
z-transform and, 512-13 


N 


Natural binary code (NBC), 793 
Natural modes. See Characteristic modes 
Natural numbers, 1 


Natural response 
difference equations and, 304-8, 319 
differential equations and, 198-99, 225 


Negative feedback, 417 

Negative frequency, 628-29 

Negative numbers, 1, 2-4 

Neper frequency, 94 

Neutral equilibrium, 208, 209 

Newton, Sir Isaac, 2, 358 

Noise, 70, 165, 382, 428, 785, 792 
Nonanticipative systems. See Causal systems 
Nonbandlimited signals, 785 

Noncausal signals, 85 


Noncausal systems, 108-10, 130, 269 
properties of, 108 
reasons for studying, 109-10 


Noninvertible systems, 112, 131, 269-70 

Noninverting amplifiers, 393 

Nonlinear systems, 101-6, 130 

Nonsingular matrices, 43 

Nonuniqueness, 538 

Normal-form equations, 901 

Norton theorem, 385 

Notch filters, 451-54, 545, 551-52. See also Bandstop filters 
Nyquist interval, 772, 773 

Nyquist rate, 772, 773, 774, 780-81, 782, 785, 789, 793, 814 
Nyquist samples, 772, 785 


O 


Observability. See Controllability/observability 
Octave, 433 

Odd functions, 96-99, 130 

Operational amplifiers, 393-94, 410-14, 467 
Ordinary numbers, 4-5 

Orthogonality, 624 


Orthogonal signals, 642, 661 
energy of the sum of, 646 
signal representation by set, 646-58 


Orthogonal signal space, 648-49 

Orthogonal vector space, 647-48 

Orthonormal sets, 648 

Oscillators, 214 

Output, 68, 101 

Output equations, 125, 127, 898, 900, 901, 916, 924-25, 927 
Overdamped systems, 420, 421 


P 


Paley-Wiener criterion, 455, 727, 782 

Parallel realization, 404-7, 525, 529, 905, 908-9, 910 
Parallel systems, 192, 397 

Parseval's theorem, 634, 651, 730, 753, 755-57, 868-69 


Partial fractions 
expansion of, 26-37, 63-64 
Laplace transform and, 349, 352-53 
modified, 36-37, 501-3 
z-transform and, 501-3 

Passbands, 451, 455, 744 


Peak time, 420, 421 


Percent overshoot (PO), 420, 421 


Periodic convolution 
of the discrete Fourier transform, 812-13, 814 
of the discrete-time Fourier transform, 867 


Periodic extension 
of the Fourier spectrum, 840-46 
properties of, 84-85 
Periodic functions 
Fourier spectra as, 850 
MATLAB on, 662-64 
Periodic signals, 129 
continuous-time system and, 637-40 
discrete-time Fourier series and, 838-39, 880 
exponential Fourier series and, 637-40 
Fourier spectra of, 840-47 
Fourier transform of, 693-94 
properties of, 83-86 
trigonometric Fourier series and, 594-612, 660 
Periods 
fundamental, 83, 129, 248, 594, 596, 838 
sinusoid, 16, 17 
Phase-plane analysis, 128, 899 
Phase response, 425, 427-29, 430-32, 433-34, 437, 438-45 
Phase spectrum, 600, 603, 619-20, 660, 705, 840 
MATLAB on, 664-68 
using principal values, 707-8 
Phasors, 19-20 
Physical systems, See Causal systems 
Picket fence effect, 800 
Pickoff nodes, 192, 261, 407 
Pingala, 795 
Pointwise convergent series, 615 
Polar coordinates, 5-6 
Polar form, 8-15 
arithmetical operations in, 12-15 
sinusoids and, 19 
Poles 
complex, 406, 503, 529 
controlling gain by, 545-46 
first-order, 434-37 
gain enhancement by, 448-49 
H(s), filter design and, 446-56 
at the origin, 433-34 
repeated, 406-7, 529, 912 
in the right half plane, 445-46 
second-order, 437-46 
wall of, 451, 546 
Pole-zero location, 544-53 
Pole-zero plots, 572-74 
Polynomial expansion, 470-71 
Polynomial roots, 579 
Positive feedback, 417 


Powers 


complex number, 12-15 
matrix, 47-48 


Power series, 48 

Power signals, 86, 129, 247-48, See also Signal power 
Practical filters, 726-29, 874-75 

Preece, Sir William, 359 

Prewarping, 577-78 


Principal values 
of the angle, 10 
phase spectrum using, 707-8 


Proper functions, 26, 27, 28 
Pulse-amplitude modulation (PAM), 790 
Pulse-code modulation (PCM), 790, 793 
Pulse dispersion, 220 

Pulse-position modulation (PPM), 790 
Pulse-width modulation (PWM), 790 
Pupin, M., 358 

Pythagoras, 1-2 


Q 


Quadratic equations, 52 


Quadratic factors, 30-31 
for the Laplace transform, 351-52 
for the z-transform, 504 


Quantization, 793, 826-29 
Quantized levels, 793 


R 


Radian frequency, 17, 94, 595 

Random signals, 86, 129 

Rational functions, 26, 27, 29, 348 

Real numbers, 4-5 

Real time, 108 

Rectangular windows, 747, 751, 754, 759 


Region of convergence (ROC) 
for continous-time systems, 195-96 
for finite-duration signals, 343 
for the Laplace transform, 341-43, 345, 346-47, 456, 458, 459-65 
for the z-transform, 495-97, 563-66, 568, 569-70 
Relational operators, 133-35 
Repeated factors of Q(x), 32-33 
Repeated poles, 406-7, 529, 912 
Repeated roots 
of continuous-time systems, 154-55, 156, 197, 211, 226 
of discrete-time systems, 278, 279, 303, 312, 314 


Resonance phenomenon, 164, 215, 216, 221-23, 318 


Right half plane (RHP), 96, 209, 211, 445-46 
Right shift, 76, 129, 508-9, 515, 516 
Right-sided sequences, 564 

Rise time, 218, 420, 423 

RLC networks, 899-900, 901, 902-3 

Rolloff rate, 749, 750 


Roots 
complex, 155, 157, 278, 280 
of complex numbers, 12-15 
polynomial, 579 
repeated. See Repeated roots 
unrepeated, 211, 226, 312, 314 
Rotational mass. See Moment of inertia 
Rotational systems, 117, 118-21 


Row vectors, 37 


Ss 


Sales estimate example, 262 
Sallen-Key circuit, 394, 473 
Sampled continuous-time sinusoids, 533-36 
Sampling, 770-836 
practical, 775-78 
properties of, 91-92, 130 
signal reconstruction and, 778-92 
spectral, 757-58, 795-98 
See also Discrete Fourier transform; Fast Fourier transform 
Sampling interval, 555-59 
Sampling rate, 250-52, 541-43 
Sampling theorem, 543, 770-78, 821 
applications of, 790-92 
spectral, 796 
Savings account example, 260-61 
Scalar multiplication, 40, 410-11, 512 
Scaling, 101-2 
of the Fourier transform, 703-4, 753, 754-55 
of the Laplace transform, 367 
See also Time scaling 
Script M-files, 227-29, 230 
Selective-filtering method, 744-45 
Sharp cutoff filter, 744 
Shifting 
of the bilateral z-transform, 568 
of the convolution integral, 172-73 
of the convolution sum, 288 
of discrete-time signals, 248 
See also Frequency shifting; Time shifting 
Sideband, 745 
Sifting, See Sampling 
Signal distortion, 719-22 


Signal energy, 69, 71, 129, 137-38, 729-32, 753. See also Energy signals 
Signal power, 69-75, 71, 129. See also Power signals 
Signal reconstruction, 778-92. See also Interpolation 


Signals, 68-99, 129-30 
analog. See Analog signals 
anticausal, 85 
aperiodic. See Aperiodic signals 
audio, 721-22, 744-45 
bandlimited, 538, 782-83, 785, 821 
baseband, 732-35, 742-43 
basis, 650, 661 
causal, 85, 129 
classification of, 82-86, 129 
comparison and components of, 642-44 
continuous-time. See Continuous-time signals 
defined, 68 
deterministic, 86, 129 
digital. See Digital signals 
discrete-time. See Discrete-time signals 
energy, 86, 129, 246-48 
error, 650-51 
everlasting, 85, 129 
finite-duration, 343 
modulating, 710, 732-35 
nonbandlimited, 785 
noncausal, 85 
orthogonal. See Orthogonal signals 
periodic. See Periodic signals 
phantoms of, 191 
power, 86, 129, 247-48 
random, 86, 129 
size of, 68-75, 129 
sketching, 22-24 
timelimited, 782-83, 798, 800 
two-dimensional view of, 728-29 
useful models, 86-96 
useful operations, 75-82 
as vectors, 641-58 
video, 721-22, 745 
Signal to noise power ratio, 70 
Signal transmission, 717-25 
Sinc function, 754-55 
Single-input, single-output (SISO) systems, 102, 128, 898 
Single-sideband (SSB) modulation, 742-45 
Singularity functions, 93 
Sinusoidal input, 
causal. See Causal sinusoidal input 
continuous-time systems and, 203, 218-20 
discrete-time systems and, 309 
frequency response and, 423-27 
Sinusoids, 16-21, 94, 95, 96, 130 
continuous-time, 258, 541-43 
discrete-time, 257-58, 538, 539, 541 
exponentially varying, 23-24, 94, 130 
in exponential terms, 21 
general condition for aliasing in, 786-89 
sampled continuous-time, 533-36 


verification of aliasing in, 785-86 
Sketching signals, 22-24 
Sliding-tape method, 296-99 
Software realization, 68, 99, 129 
Spectral density, 686 
Spectral folding. See Aliasing 
Spectral interpolation, 797 
Spectral resolution, 800 
Spectral sampling, 757-58, 795-98 
Spectral sampling theorem, 796 
Spectral spreading, 747, 748-50, 751, 754, 800 


Springs 
linear, 117 
torsional, 118, 119 


Square matrices, 37, 38, 42-43, 45, 46-47 
Square roots of negative numbers, 2-4 
Stability 


BIBO. See Bounded-input/bounded-output stability 


of continuous-time systems, 207-14 
of descrete-time systems, 270, 311-17, 319 
internal. See Internal stability 
of the Laplace transform, 381-84 
marginal. See Marginally stable systems 
of the z-transform, 523-24 
Stable equilibrium, 208 
Stable systems, 112, 270 
State equations, 125, 126-127, 128, 898, 900, 949 
solution of, 912-26 
for the state vector, 928 
systematic procedure for determining, 901-12 


State-space analysis, 898-961 
controllability/observability in, 934-40, 948 
of discrete-time systems, 940-48, 949-51 
in MATLAB, 949-57 


State-space description of a system, 124-28 
State variables, 124-125, 131, 898, 899, 948-49 
State vectors, 926-34, 948 

Steady-state error, 420, 421, 423 


Steady-state response 
in continuous-time systems, 429-30 
in discrete-time systems, 532 


Stem plots, 320-21 
Step input, 419-21 


Stiffness 
of linear springs, 117 
of torsional springs, 119 


Stopbands, 451, 455, 744 
Subcarriers, 745 
Sum. See Convolution sum 


Superpositon, 102, 103, 105, 130 
continuous-time systems and, 169, 171 


discrete-time systems and, 294 
Symmetric matrices, 38 


Symmetry 
conjugate. See Conjugate symmetry 
exponential Fourier series and, 632-33 
trigonometric Fourier series and, 609-10 


Synchronous demodulation, 736, 739, 740, 743-44 


System realization, 399-414, 467, 525-31, 572 
cascade, 404-7, 525, 529, 905, 908 
of complex conjugate poles, 406 
differences in performance, 530-31 
direct. See Direct form | realization; Direct form II realization 
hardware, 68, 99, 129 
parallel. See Parallel realization 
software, 68, 99, 129 


Systems, 99-128, 129 
accumulator, 266, 301, 524 
analog, 111, 131, 267-68 
backward difference, 265, 301, 524, 574-75 
cascade, 192, 194, 397 
causal. See Causal systems 
classification of, 101-12, 130-31 
continuous-time. See Continuous-time systems 
control. See Control systems 
critically damped, 420, 421 
data for computing response, 100-101 
defined, 68 
digital, 111, 131, 267-68 
discrete-time. See Discrete-time systems 
dynamic, 107, 130, 270 
electrical.See Electrical systems 
electromechanical, 121 
feedback. See Feedback systems 
finite-memory, 107 
identity, 112, 194, 269 
input-output description, 113-21 
instantaneous, 107, 130, 270 
interconnected. See Interconnected systems 
invertible, 112, 131, 269-70 
linear. See Linear systems 
mathematical models of, 99 
mechanical, 117-21 
minimum phase, 446 
multiple-input, multiple-output, 102, 128, 898 
noncausal, 108-10, 130, 269 
noninvertible, 112, 131 
nonlinear, 101-6, 130 
overdamped, 420, 421 
parallel, 192, 397 
phantoms of, 191 
rotational, 117, 118-21 
single-input, single-output, 102, 128, 898 
stable, 112, 270 
time-invariant. See Time-invariant systems 
time-varying. See Time-varying systems 
translational, 117-18 
two-dimensional view of, 728-29 
underdamped, 420 
unstable, 112, 270 


T 


Tacoma Narrows Bridge failure, 223 

Tapered windows, 750, 754, 800 

Taylor series, 48 

Théorie analytique de la chaleur (Fourier), 614 
Thevenin's theorem, 385, 390 


Time constant 
of continuous-time systems, 216-21, 226 
of the exponential, 22-23 
filtering and, 218-20 
information transmission rate and, 220-21 
pulse dispersion and, 220 
rise time and, 218 


Time convolution 
of the bilateral Laplace transform, 463 
of the discrete-time Fourier transform, 866-68 
of the Fourier transform, 712-14 
of the Laplace transform, 368 
of the z-transform, 511-12 


Time delay, variation with frequency, 721 


Time differentiation 
of the bilateral Laplace transform, 463 
of the Fourier transform, 714-16 
of the Laplace transform, 364-66 


Time-division multiplexing (TDM), 745, 790 


Time-domain analysis, 718-19 
of continuous-time systems, 151-244 
of discrete-time systems, 245-339 
of the Fourier series, 600, 603 
of interpolation, 779-81 
state equation solution in, 919-25 
two-dimensional view and, 728-29 


Time-frequency duality, 699-700, 719, 753 


Time integration 
of the bilateral Laplace transform, 463 
of the Fourier transform, 714-16 
of the Laplace transform, 366-67 


Time-invariant systems, 130 
discrete-time, 269 
linear, See Linear time-invariant systems 
properties of, 106-7 


Time inversion, 704 
Timelimited signals, 782-83, 798, 800 


Time reversal, 129 
of the bilateral Laplace transform, 463 
of the bilateral z-transform, 569 
of the convolution integral, 180, 183 
described, 80-81 
of the discrete-time Fourier transform, 860-61 
of discrete-time signals, 248-49 
of the z-transform, 513-14 


Time scaling, 82 
of the bilateral Laplace transform, 463 
described, 77-80 
Time shifting, 82, 129 
of the bilateral Laplace transform, 462 
of the convolution integral, 180 
described, 75-77 
of the discrete Fourier transform, 812 
of the discrete-time Fourier transform, 862 
of the Fourier transform, 705 
of the Laplace transform, 360-62 
of the z-transform, 507-11, 515 
Time-varying systems, 130 
discrete-time, 269 
linear, 107 
properties of, 106-7 
Torque, 118, 119, 121 
Torsional dashpots, 118, 119 
Torsional springs, 118, 119 
Total response 
of continuous-time systems, 197-98 
of discrete-time systems, 303-4 
Traité de mécanique céleste (Laplace), 358 
Transfer functions 
analog filter realization with, 554-55 
block diagrams and, 397-99 
of continuous-time systems, 195-96, 225 
of discrete-time systems, 302-3, 519-23, 571 
from the frequency response, 446 
inadequacy for system description, 939-40 
realization of, 399-401, 402, 403, 404-5, 407, 408, 410, 525, 527 
state equations from, 901, 904-12 
from state-space representations, 952-53 
Translational systems, 117-18 
Transposed direct from II (TDFIl) realization, 407-9, 955, 956 
state equations and, 905, 907-8, 910 
z-transform and, 525, 526-28, 529-30 
Transpose of a matrix, 39 
Triangular windows, 747. See also Bartlett window 
Trigonometric Fourier series, 629-30, 631, 634, 639, 657-58, 661 
periodic signals and, 594-612, 660 
sampling and, 771, 776 
symmetry effect on, 609-10 
Trigonometric identities, 49-50 


Tukey, J. W., 817, 818 


U 


Underdamped systems, 420 

Undetermined coefficients, method of, 199-203 

Uniformly convergent series, 615 

Unilateral Laplace transform, 341, 343-46, 347, 456-58, 467 
Unilateral z-transform, 495, 497, 572 


Uniqueness, 346 
Unit delay, 522-23, 525 
Unit gate function, 687 
Unit impulse function, 130 
of discrete-time systems, 252-53, 319 
as a generalized function, 92-94 
properties of, 90-94 
Unit impulse response 
of continuous-time systems, 164-69, 171, 191-95, 223-24, 225, 728 
convolution with, 173 
determining, 223-24 
of discrete-time systems, 282-86, 300-301, 318 
Unit impulse train, 694 
Unit matrices, 38 
Unit step function, 87-90 
of discrete-time systems, 253 
relational operators and, 133-35 
Unit triangle function, 687 
Unrepeated roots, 211, 226, 312, 314 
Unstable equilibrium, 208 
Unstable systems, 112, 270 
Upper sideband (USB), 734, 735, 742-44 


V 


Vectors, 37-38 
basis, 648 
characteristic, 45 
column, 37 
components of, 641-42 
error, 642 
MATLAB operations, 56-57 
matrix multiplication by, 41 
orthogonal space, 647-48 
row, 37 
signals as, 641-58 
state, 926-34, 948 


Vestigial sideband (VSB), 745 
Video signals, 721-22, 745 


W-Y 


Weber-Fechner law, 432 


Width 
of the convolution integral, 173, 189 
of the convolution sum, 289 


Window functions, 746-51, 753-54 


Zero-input response, 105 
of continuous-time systems, 152-64, 197-98, 215, 225 
described, 102-4 
of discrete-time systems, 276-82, 308, 312 
insights into behavior of, 163-64 
of the Laplace transform, 373, 374 
in oscillators, 214 
zero-state response independence from, 162 
of the z-transform, 518-19 


Zero matrices, 38 
Zero-order hold (ZOH) filters, 780 
Zero padding, 803-4, 824-25 


Zeros 
controlling gain by, 545-46 
first-order, 434-37 
gain suppression by, 449-50 
H(s), filter design and, 446-56 
at the origin, 433-34 
second-order, 437-46 


Zero-state response, 105 
causality and, 173-74 
of continuous-time systems, 152, 162, 169-98, 225, 519-23 
described, 102-4 
of discrete-time systems, 286-304, 308, 319 
of the Laplace transform, 373, 374, 376-77 
zero-input response independence from, 162 
of the z-transform, 518-19 


z-transform, 494-593 
bilateral. See Bilateral z-transform 
difference equation solutions of, 494, 515-24, 571 
direct, 494-95 
discrete-time Fourier transform and, 858-59, 878-80, 881 
existence of, 497-99 
inverse. See Inverse z-transform 
properties of, 506-15 
stability of, 523-24 
state-space analysis and, 943, 947-48 
system realization and, 525-31, 572 
unilateral, 495, 497, 572 


